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PUBLICITY WORK FOR BETTER SUPPORT 
OF RURAL SCHOOLS 


CARTER ALEXANDER 


For years the advocates of public education have been 
troubled about the rural school. To them an important goal of 
education has been approximate equality of educational oppor- 
tunity, and they have known that country children in most 
places have had nothing like the opportunities for schooling 
which are open to city children in the same sections. Whatever 
the biases of these advocates, they have almost invariably stipu- 
lated that the rural schools of the state must have greater rev- 
enues before the rural children can have an equal chance at edu- 
cation, But probably not one such advocate in a hundred has 
thrown a spark of light on the crucial problem involved. This 
problem is how to get the rural taxpayer, who has always borne 
and must for some time to come continue to bear the bulk of 
the expense for rural schools, to be willing to pay more taxes, 
to agree to a larger school district, or to vote for a tax reform 
that will produce greater revenues for schools. Until accurate 
knowledge of how to influence the country taxpayer favorably 
to these ends is secured, pronouncements on what ought to be 
done for rural-school support are for all practical purposes merely 
pious wishes. 

In this situation, and perhaps because this is an age of pub- 
licity, it is natural to think of what might be accomplished by 
the right kind of public appeal. But although publicity work has 
had signal success in securing better support for schools and for 
numerous other social institutions in cities, very little is known 


l 


- ae 
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of its possibilities for helping country schools. In a few scat 


tered places local or state publicity campaigns for putting rural 


hools on a better financial basis appear to have been success 


ful. But all such work has had to be more or less a groping 


the dark. Accordingly, light is needed on the possibilities and 


i 


limitations of methods for securing better rural-school support 
The writer, because of his interest in publicity for schools, was 
asked to start such a study. This analysis is the result.’ 
\ good publicity man attacking the problem of how to secure 
etter support for rural schools through publicity would at on 
about securing accurate information on the following: (| 
Who are the persons that actually decide the amount of sy 
port for rural schools? (2) What are their chief characteristi 
must be considered if such support is to be secured? (3 
What are the direct appeals that will influence them favorably 
nd how may their objections be handled? (4) How may thes 


appeals be presented successfully? (5) Good examples 
descriptions of successful appeals or campaigns for better school 
rt in rural communities. (6) A bibliography or list of 
urces and suggestions for material and its presentation. Let 


is then consider these in order. 


| WHo ARE THE PEOPLE THAT ACTUALLY DECIDE THI 


AMOUNT OF SUPPORT FOR RURAL SCHOOLS? 


One of the axioms of an effective publicity man is: The 
s no such thing as a general public. To him the public alw: 
means certain well-defined groups of varying importance tl 
st be pproached by different ways and with different 
ed from a paper prepared for the Committes 
National Council of Education, N. E. A. The pay 
ssible save for the cooperation of the rural educat 
rs College. With the aid and approval of Profes 
Ml ( students in the department, Misses Frances H. Clark, O 
kh. Jastram, Orpha McPherson, Mrs. Katherine M. Ste 
Mr. H PI ps, met the writer once a week for six weeks in the s} 
a the main consists of conclusions reached by 
I yusly had wide experience in the rural educat 
came poss ble or ly thr ugh the cooperal 
s in rural-school work in various parts of the country, W! 


ns cannot be listed here for lack of space 
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peals. His first work in a given situation is always to discover 

important groups and their relative importance. 
In listing such groups for the support of rural-school work, 
ne thing must be clearly in mind at the outset. If the move for 
l-school support involves legislative action by the state— 
| most effective moves of this kind do—the rural voters con- 
the situation. Whether the increase is to be determined by 
titutional amendment, legislative enactment, a general board, 
county superintendent, or local voters, in practically every 
nce the rural voters decide the issue. City voters seldom 
ect to more state money for rural schools; rural voters often 
For instance, several years ago in Wisconsin the writer 
nd a county without a second supervising teacher because 
e farmers feared the increased expense. This expense would 
ve been paid by the state and that county’s part would have 
unted to $33 a year or one-half cent per pupil in the county 
In another county for the same reason a supervising 
was refused a salary raise of $100 per year when that 
's increase for the raise would have been less than one 
From a political standpoint, if enough rural voters really 
increased state school revenue, governing officials and 

s in other districts will not seriously oppose them. 

rural situations certain distinctions as to people 
be made. The following classifications are suggested, 


ple being named in italics. It will be under- 


ore up Oot pe 
, 


that the classifications are not always mutually exclusive 


st rural areas, men have much more to say about increases 





ol revenues than do women. Children have much less 
nce on the decision than in cities because they include few 
school age and are consequently less considered. More- 
hey are not aroused to the need of more money for schools 
heir teachers, as are city children under older and more ex- 
nced teachers and superintendents. -Fortunate is the rural 
with a fair number of moderns, the younger voters, those 


have been away to school and those who have fairly recently 


ed into the district Many of the most backward rural 
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regions are afflicted with many old fogies, those who have never 


been where they could get new ideas and have never secured such 





ideas through reading. They are often the descendants of 



























families that for several generations have been living in the 
vicinity. People with children and those without children con- 
stitute two entirely different groups that must be met with 
altogether different appeals. Individuals as distinguished fron 
organizations are much more important among farmers than in 
cities. But farmers can still be reached through their organiza 
tions if their leaders are convinced. A serious difficulty arises 
here, as compared with city conditions, because the organizations 
of farmers are seldom coterminous with the school fiscal areas 


However, in many small districts there are factions that will vote 


as the leaders do, and foreign language groups are easily reached 
if their leaders are converted. 
The following distinctions should be made in certain locali 
ties. Owners may live on their farms and possibly have childre: 
| in rural schools, or they may live at a distance. In the latter 
case their own children or the children in whom they are inter 
ested may attend school in districts not including the farm proj 
erty. Owners are markedly different from tenants who may 
temporary and who in any event are much less important f 
deciding increases in rural-school taxes. The inhabitants 
certain small rural areas may be largely one foreign languag 
jroup. Small areas in which different languages are strong) 


( 





represented may easily prevent moves for larger school-support 
districts if the matter is left to local voters. Whites and negri 

are distinguished by the laws requiring separate schools for th 
two races in the southern states. The distinction arises anywher 
if negro children become sufficiently numerous; but in tl 
northern states few negroes settle in rural areas. Private school 
in rural areas usually exist mainly for secondary-school wor! 


barochial schools for elementary schooling. The latter son 





times occur in groups using foreign languages. 
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r Il. Some CHARACTERISTICS OF THOSE WHO DECIDE THE 
h AMOUNT OF St PPORT FOR RURAL Sc HOOLS 


The list here given aims to include those characteristics nor- 
ily to be expected. In certain places, the opposite or at any 
rate marked variations, may be found on certain items. It is 
bably safe to expect any rural population to exhibit nearly all 
characteristics here given until evidence to the contrary has 
been secured. (1) Conservatism sometimes appearing as actual 
stility to new ideas. Only a few rural populations fail to ex- 
bit this conservatism—for example, those where nearly all 
IS the people have moved in recently (as in an irrigated area), or 
S where a land company is trying to attract settlers or outside 
e purchasers, or where there is an economic crisis as there is at 
d present in the west central states. Yet even in such cases the 
tions are often towards conservatism. (2) PBackwardness. 

In many states the rural population does not contain the most 
lligent, the best informed, the most literate, or the most pro- 
ressive groups of the population. This means that the rural 
s in these states are likely to have that portion of the state’s 
pulation which knows least about schools and is least qualified 
iss upon questions connected with them. (3) Jntense indt- 
wism. Land ownership, personal feuds, and the natural 
tion of farm life produce less following of leaders than in 

s, and a much greater clinging to local “rights.” (4) Dtffi- 
in understanding school financing on a large or modern scale 


experienced by many farmers for very natural reasons. Ex- 





tin dairy regions, many of them use comparatively little cash. 


y cannot easily conceal their property from taxation and 
es must be paid in cash. It is a commonplace among politicians 
the rural vote can always be secured on an economy plat- 
. tort Part of the trouble in connection with school improve- 
may be due to a lack of knowledge of ways of appealing 
armers. Some of them seem to have plenty of cash for 


ail-order houses of which they are the largest customers. 





5) Difficulty in seeing the economic value of education. Farmers 


turally see little relation between the schooling given in their 





I 
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schools | 


capacity on the farm. The value of high-school education 
opening a way to the professions appeals little to many farme 
because it means taking their children away from home ar 
neighborhood 6) Inaccessihility through reading. The ru 
population is relatively inaccessible through printed matter. 
must be reached by word of mouth and by personal contacts t 
greater extent than is the case with city people. But fortunat 
the rural people probably read more carefully and think 1 
bout what they read, than do city people. Furthermore 
ural districts, a school circular will encounter far less comy 


tion from printed matter than in cities 


IT] SUCCESSFUL APPEALS TO RURAL VOTERS FOR BETTE! 
ScHooL SUPPOR' 
eood publicity man endeavoring to secure better 1 


school support would prepare both for direct appeals and 


PI 
handling objections \s regards direct appeals, the comn 
sense way is, of course, to appeal to the strongest motives tl 
will induce farmers to vote additional school taxes. But sin 
no usable knowledge of these motives can be found, the writ 


has endeavored to start work that would supply this lack. T 
group of students referred to above formulated all the import 
motives they could think of in this connection, nineteen in 
ber. Great pains were taken to phrase these motives in si 
language free from practical ambiguities but no effort was m: 
to split psychological or other theoretical hairs 


The next problem was to decide which motives influet 


I 
ters. It is comparatively easy to find out how people v 
it is a wholly different matter to discover just why tl 
vote as they di Probably in many cases they themselves do 1 
know. The only feasible method seemed to be to take the ju 





ent of experienced leaders in rural-school work. While it 
felt that the results of this method could not be absolutely 


tain, it seemed reasonable to expect that they would be far n 








by cheap, young, and incompetent teachers and earning 


| ‘ 
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ible than any mere analysis and theorizing. Accordingly, 

list was then submitted to eighty-six men and women who 

id had successful experience in getting more money for rural 
ols, on at least a rural high-school or county-wide basis. 

On the basis of his own experience and observation, each of 

se rural-school leaders signified by ranks from 1 to 19, “the 

ve strengths of the motives that, by and large, influence 

ple to vote more support for rural schools.’’ The rankings 

re then combined by the simple method of adding the rank 

bers for the various motives, the one with the smallest sum 

rank numbers being considered the strongest, and so on. 

Since twenty-six of those ranking the motives had had at least 

te-wide experience, their rankings were put into a separate 

* The sixty with somewhat smaller experience were kept 

nother group.” 

he two different combinations are given in Lists I and II. 

ill be noted that the motives do not have precisely the same 

in the two lists, although the agreement is noticeably 

Just why these differences obtain, no one at present 

vs. In all probability, the state workers are accustomed to 

king on a larger scale with larger projects, where there is 

hope of success. They doubtless have more frequent con- 

ith progressive citizens and think more often of securing 

pport of city people and members of the legislature or of 

gress. It is possible also that the local list would have given 

rent results with a different proportion of Wisconsin people. 

it cannot be too emphatically stated that these two formula- 

re far from final or authoritative. They do, however, 


esent the combined judgment of authorities in this field 


| Che twenty-six persons of at least state-wide experience in rural educa 
ne or more representatives with close associations with rural-school 
each of the following states: Alabama, Arkansas, Connecticut, Dela 


I ana, lowa, Kentucky, Maine, Maryland, Michigan, Mississippi, Mis 
Montana, Nebraska, New York, South Dakota, Tennessee, Texas, Vir 
Wisconsin. Several of | 

. approximately nation-wide observations. 


these people are national authorities in the 


+} 


nty-five of these were from Wisconsin and the others represented 
nee in Alabama, Florida, lowa, Kansas, Kentucky, Maine, Maryland, 
Missouri, Nebraska, New Jersey, New York, North Carolina, Penn 


, Tennessee, Texas, and Virginia. 
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and, as such, are undoubtedly apt to be nearer the true rankings 
than the isolated judgments of individuals can be. It is recom 
mended that any person who wishes to undertake publicity work 
for better school support should select the list that better fits 
his particular situation. He should then run down the list, 
checking each motive that applies. Not all motives can appl) 
to every situation. For instance, the motives relating to high 


schools clearly cannot be utilized in a situation where a hig! 


school is not even mentioned. Of the motives that do apply, 
can be reasonably certain that any one is stronger than th 
coming after it and weaker than those coming before, unless 


has unimpeachable evidence to the contrary. Just how mu 


( 


stronger or weaker it is, no one can now say. It may be tl 


ae 
I 


some of the motives coming close together are virtually ties. TI 


writer is continuing this work on motives and hopes to present 


a later date evidence on their approximate relative strengtl 


After such strengths are roughly determined, all publicity w 


should stress the motives in the order of their importance. 


LIST I. RELATIVE STRENGTHS OF THE MOTIVES THAT INFLI 
PEOPLE TO VOTE MORE SUPPORT FOR RURAL SCHOOLS 

is determined by the rankings of 60 successful school worl 

rural high-school or county-wide experience in 17 states.) 

1. To give one’s children as good a chance in life as any childret 


2. To give children a better education than their parents had. 
3. By making farm life more attractive through good schools cl 
be induced to stay on the farm. 
To give children an easier time than their parents had 
[lo give children something of value which cannot be taker 


6. To enable the community to have as good a school as some 


particular school 

7. Good schools will bring a better class of farmers to the neigh! 
] d 1 so give one’s children better associates. 

8 the case of a rural high school, children can go to it from |! 


hus escaping possible moral dangers of boarding in town 
Farm property will increase in value because of good schools 


increases will enable the district to have the best school in its 


ing a good rural high school, children can stay at 


ger and be a greater comfort to their parents. 
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ys he increase is not so heavy as it appears at first thought. 
he increase will bring much more state school aid of which the 


es will pay the bulk. 

, he results claimed to be possible under the increases have actually 
een secured in real schools by similar expenditures and these 
hools can be visited and observed by the farmers or their 


presentatives. 

ucational authorities, such as members of the State Department, 
e State University, a Normal School, or the County Superin- 
dent, say that these amounts of expenditure are needed. 

» give the children of other people in the country as good a chance 
the city children have. 


\ community center for neighborhood enjoyment can be created by 


Expenditures for public schools are the one public expenditure that 
ot be withheld at one time and later made up; a citizen voting 

wn such expenditures does so at his own and the country’s peril. 
good politics always to support increased expenditures for 

| schools, when such are shown to be needed and when there is 


sonable assurance that the money will be economically used. 


IST II. RELATIVE STRENGTHS OF THE MOTIVES THAT INFLUENCE 
PEOPLE TO VOTE MORE SUPPORT FOR RURAL SCHOOLS 


determined by the rankings of 26 successful rural-school 
at least state-wide experience in 17 states and familiar with 
nditions in many other states.) 


ve one’s children as good a chance in life as any children get 
e case of a rural high school, children can go to it from home, 
avoiding possible moral dangers of boarding in town 
ing a good rural high school, children can stay at hom 
er and be a greater comfort to their parents. 
give children a better education than their parents had. 


ive children something of value which cannot be taken from 





king farm life more attractive through good schools, chil- 


h may be induced to stay on the farm. 
1 schools will bring a better class of farmers to the neighbor- 
; nd so give one’s children better associates. 
give the children of other people in the country as good a chance 
ity children have. 
property will increase in value because of good schools 
give children an easier time than their parents had 
; \ community center for neighborhood enjoyment can be created by 





more money, especially through a consolidation project 
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] 


enable the community to have as good a school as some ot 


' 
particular school 


he ncreases will enable the district to have the best school 


ss or region. 
1 esults claimed to be possible under the increases have actu 
been secured in real schools by similar expenditures and thi 
Is can be visited and observed by the farmers or the 
tatives 
° ( ease will bring uch more state aid of which the 
p the bulk 
6. The increase is not so heavy as it appears at first thought. 
Educational authorities, such as members of the State Departn 
e State University, a Normal School, or the County Superi 
tendent, say that these amounts of expenditure are needed. 
18. Expenditures for public schools are the one public expenditure tl 
cannot be withheld at one time and later made up; a citizen voti 
ywn such expenditures, does so at his own and the country’s pe 
sg 1 politics always to support increased expenditures 
rural schools, when such are shown to be needed and when tl 
nce that the money will be economically 
\ll experience in city campaigns for increased school suy 
port and in commercial salesmanship as well, suggests the n 


of determining for any rural situation, the probable object 


to the proposed increase. Then offsets to these objections should 
ye ready. In salesmanship an objection is counted a sign 
interest. The salesman’s business is to transform the energ 


signified by the objection so that it flows in the direction of hi 


proposition rather than against it. Lack of space forbids t 





| 
presentation of the complete list of common objections and th 
offsets formulated by the group. The following samples w 
give the idea: (1) Objection. The old rural school was g 
enough for my father and for me, so it is good enough for 
children. Offset. Have other farmers meet this by calling att 


tion to the changes in farm machinery, roads, autos, etc., 
sk if the children are not likewise entitled to better thing 
Objection. Let those wanting high-school education for rut 


children pay for it themselves. Offset. Show that this is u 


4 


\merican and appeal for a square deal and an equal chance 


the country child with the city child. 





; 
: 
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\ How to PRESENT THE APPEALS SUCCESSFULLY 


Successful publicity work here would involve a check list of 


to be d 


one, in chronological order for the best results, and 
t of cautions to be observed throughout the work 


CHECK LIST OF THINGS TO BE DONI 


particular situation, determine exactly who will decide tl 


. 1 | . | 
of support for the rural schools concerned, using the 
Ss given in Section | 
1 ' | £ ; +} hilit ; 
‘ eroups in order otf imp ink tor their abil y secure 
} 1 } ] mT rt 
r east S\ ol ppo! 
' 1 | 
( rly in mind the characteristics of each important group that 
, 1 ‘ ‘ | 
kel into account if increased school support is to tbe 
the tes in Sectio I] 
etter <¢ the sts ot Motive in Section IT] taking t 
+ ‘ } ; } } 
) ( ituation 1 the order of tneir trengt 
; ] } ; 1] ; ; 
( ] V LncSs« Will ap C various LI 
t hye ’ enced ¢f yrahbl Remembe hat these motive 
t 1 " Y ] ‘ ‘ 
eT l pop eenera They ay not apply w 
' Hacry r sot ’ sara! +1 ’ 1] 
é particular situati 1 hardly universally t 
; 7] 
[ wi » count 1S y t ot the 1 tives s et 
, , 
ill possible voters 
( CC ons Ke to be r S¢ lt tne va uS 2 ~ 
\ 1 esstul o . 
+ ‘ ; | ' t 
( ( ( r Ke il MAIL oO 
, . sl ; 1 , 
) 1 Qui conterence wi tew leaders Phe ( 
1? | 
\\ ( smaii 1 ters or with something tha 
, , 1 
= * t CK (as Io! t ( | y 
eTe,T bl ror T <T ti > 
; ] + 11 ] ; + | 
hn gen | Will tak¢ go ne secure i ( 
’ rl | h ; ; 7 41 + 
ced « ges in org i or increas I 
t s hest plan t five 1 te ear pet 
IBSERVED TIII I ICI I 
7 7 
1 work Ilvisable. espect! ir secur the ¢ 
, 
expect too n trom reading matte 
} + } | ] y 
é esit or better schools disk Ss increases costs 
. ' ‘ na 1 
in private life spend their money, and 
r } } ] ] 
( é I nytning they desire strongiy enoug 
} j ] 
ntended for anv group must of course be lap 1 
| - + ] 7 , 1] 
1 group Fr ploy illustra ons and language that w | 
, ¢ 4 1 1 11 
members, and iet these he presented by those personally 
t ( oO the group 
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12 
Farmers care little or nothing for per capita costs. They wish 
know what the improvement will cost the district as a whole or the: 
ndividually 

6. In many places it will be necessary to show clearly that there is 1 
hope of materially bettering the rural schools until a larger ad 

rative unit, such as the consolidated district or the county unit, 

ecured. 


V AND VI. EXAMPLES OF SUCCESSFUL APPEALS FoR BETTE! 
RURAL-ScHOOL SUPPORT; BIBLIOGRAPHY 
Scattered examples of material and some references have beet 
found But in the time available we have not been able t 
analyze or test them so as to permit a worth-while estimate 





their value. Until this is done, they cannot be thrown int 
usable torm 

Meanwhile, those who must issue publicity material for bet 
ter rural-school support, will find the quickest sources of supy 
to be: The Journal of the National Education Assoctiat 
Washington, D. C.; the Educational Division of the Inte: 
national Harvester Company, Chicago; and School Life, whi 
can be secured through the United States Bureau of Educati 
What appears to be valuable material in this field has been sent 
out in connection with campaigns from the state departments 
\labama, Indiana, Maryland, Missouri, South Dakota, Tes 
and Utah. The publicity Committee of the Wisconsin St 
Teachers’ Association has issued many appeals directed es 
cially toward the improvement of rural schools. Very promis 


material in printed form has come from Montgomery Count 


\labama, from Monterey County, California, and from Cuy 


h County, Ohio. Similar material in mimeographed f 


~ 





has been issued by Prince Georges County, Maryland. 
Many valuable suggestions and references on general sch 


in fiscal matters will be found in Alexander’s “Sc! 


- 
“ 


Statistics and Publicity’’* and in “Publicity Campaigns for Bet 
School Support” by Alexander and Theisen.° 


‘Alexander, Carter School statistics and publicity. New York: 5 


Burdette and Cor pany, 1919. 332 pp 
Alexander, Carter, and Theisen, W. W. Publicity campaigns for ! 
hool support, (School Efficiency Monographs). Yonkers: The World 


Company, 1921 164 pp. 
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In the foregoing the writer has merely tried to start work 
hich might ultimately enable rural-school leaders to use pub- 
licity methods for better school support as effectively as do 
leaders in other fields. No one realizes better than he how un- 
satisfactory is our present knowledge of such matters. He has 

und it extremely difficult to discover sound methods of pro- 

lure in publicity work; but that is no reason for refusing to 
ke the attempt. He will, of course, be gratified if the 
ilyses and suggestions here given are found helpful by rural 
education leaders, or if they stimulate such leaders or educational 
search men to produce things that will be helpful. But he is 
h more concerned with securing knowledge that is accurate 

d reliable, with finding out just where these suggestions are 
nd and where they are weak, and just how sound or weak 

are. We need something better and more dependable as 
n as possible. 
lf the rural-school leaders can find out how to use publicity 
hods effectively, they will be greatly relieved from their 

est source of worry at present—inadequate financial sup- 
rt. But guesses, half-baked ideas, or biases about publicity 
«ls cannot set them free. Only the truth—accurate knowl- 

lge of such methods—can do that. Hard work by many capa- 
persons will be necessary before this knowledge can be se- 
red. But the work will offer a highly stimulating challenge to 
petent educational research workers, particularly those well 
unded in social psychology and in accurate observation of 
tical politics. Any such research worker who wishes to make 





ctivities count for the improvement of rural education can 
sure of one thing. Research by him on rural-school work 
ng the lines pursued so far will in most instances produce 
ly trivial results compared to what the same energy could 
mplish if it were efficiently applied to securing accurate 
wledge of how to get better rural-school support through 


blicity work. 











THE STANDARDIZATION OF TESTS 
PETER SANDIFORD 


Ontario College of Education, University of Toronto 


The problems of the standardization of tests and scales may 
be considered from many points of view, chief of which are th 


following: (1) the units and the zero points of tests; (2) th 


tandardization of tests; (3) the validity of tests. 


\ 

these three aspects of the problem are not mutually excl 
mount of overlapping is not sufficiently serious to e1 
writer who attempts to discuss them. As the discussiot 
d (2) demands a knowledge of the mathematical theo 
which I cannot lay claim, the major part of this 


re around (3). 


UNITs AND ZERO POINTS 

In all physical standards there are zero or reference points 
and the units are arranged so that all parts of the scale ar 
strictly comparable. Most of the traits, however, that psychol 
gists and teachers wish to measure are variable ones, and tl 
task of discovering suitable zeros and units for them is far fro 
easy. At present the utmost confusion prevails owing to the \ 
riety of units and zeros in use. There is a different zero point 
lor practically every scale and test, and the units used are as 1 
merous as the zeros. In the Binet-Simon scale the zero 1s t 
time of birth, and the unit one year of mental growth. The ze 


is one that everybody understands, but the unit probably va 
trom year to year. It is extremely unlikely, for example, t! 
the amount of mental growth between 5 and 6 is the same 
that between 15 and 16. The unit, therefore, is an unsatisf 
tory one 

[ am in no position to dogmatize on the subject, but it s¢ 


; 
| 


o me that the science of mental measurements will be furthe 


‘A paper presented at the joint meeting of Sections I and Q of the A: 
Association for the Advancement of Science, Toronto, 1921. 
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st assuredly by the adoption of a reference point in the cen- 

RS ter of the seale with a zero having some definite relationship 
and of units which take into account the variability of 

e measurements from the central tendency. The index method 


Weiss and the “standard measures’’—‘s”, “m’”’ and “v’—of 


may Kelley were early attempts at the solution of the zero and unit 
the problem. McCall? has more recently recommended the mean per- 
the formance of children between the ages of 12 and 13 as a refer- 

\ ence point (50) with a zero point situated 5 S. D. below it, and a 
asa unit of measurement. The unit “T’’, named in honour of 
e1 (horndike and Terman, is the standard deviation of the variabil- 
ee ty of twelve-year-old pupils multiplied by ten. For this unit 


icCall claims the following advantages. It is “equal at all points 
this n the difficulty scale, which is the chief characteristic of the unit 
employed by Thorndike and his students (i. e., some function of 
variability as a unit). It is based upon chronological age, which 


s the chief characteristic of the work of Terman and his prede- 


ints essors. It 1s a function of the variability of a defined group and 

group which is easily located. A scale which uses this unit 
ol reaches as low and as high as the ordinary requirements of prac- 
t! tical measurement. Special extension at the top or bottom is a 
rol simple process. The subsequent improvement of scale values is 
\ impler still. And not of least importance is the fact that the 


oint nstruction of the scale which employs this unit is not particu- 
laborious. In sum, the proposed unit combines most of the 

virtues and eliminates most of the defects of the two chief con- 
porary methods of constructing mental scales. In a certain 


it unites the two great lines of scale development.”” Happy 


t] indeed will mental testers be if McCall’s claims are substantiated. 
‘ ut, seriously, there is so much confusion reigning in regard to 


and units that it behooves all who have the necessary knowl- 
lige and skill to give themselves to the task of helping to create 


r out of the present chaos. 


* McCall, William C. ‘‘ Proposed uniform method of scale construction,’’ 
vers College Record, 22:31-51, January, 1921. 
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THE CRITERIA OF STANDARDIZATION 


It is of the utmost importance for the user of scales and tests 
to know when they have, or have not, been properly standardized 
Some of them have been finally standardized before they reac! 
the user; others are sent out tentatively standardized and the re: 
ords made from them are used in making the norms more per- 
fect. Thorndike’s Handwriting Scale, Ayres’ Spelling Scale, 
Pintner-Paterson’s Performance Tests, and Terman’s Revisi 
of the Binet-Simon Scale are examples of the first type. Thor 
dike’s Supplementary Matriculation Test and the Otis Group I: 
telligence Test are examples of the second. In the last analysis 
a test is standardized when additional results or records obtained 
from its use do not alter the general form of the distributions 
(measured by variability) or disturb their central tendencies 
Theoretically, a test should only be regarded as standardized 
when an infinite number of unselected subjects have been tested 
with it and the results statistically analyzed. Practically, h 
ever, constancy of norms is reached fairly soon. As we sh 
see later the chief difficulty in standardization is not in the nur 
ber of cases, but in the inadvertent use of selected subjects. 





There are many minor criteria of standardization which ; 
chologists and educators habitually use, and common sens« 
well as experience justifies them. The most important on 
the assumption that the records of measurement of any t1 
providing a sufficiently large number of unselected but homog 
neous individuals is taken, will be distributed according to t 


normal surface of frequency. If the records from a test wher 





graphed show marked deviations from the normal surface of fr 
quency they should be regarded with suspicion. Skewness, h 
ever, is sometimes the normal condition of affairs. The weig! 
of adult Anglo-Saxons are skewed to the right; there are m 
of them over-weight than under-weight. The heights and inte! 
ligences of these same Anglo-Saxons are, however, normally d 
tributed. Terman was perfectly correct in expressing satisfa 
tion when the I1.Q.’s of his subjects were found to be distribut: 


according to the normal surface of frequency. 
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\ second important criterion, which is used where the rec- 


rds show a steady increase or decrease, is the regularity of the 


phed result. If there are “jogs” in the curve, sudden changes 


n direction, they are justly regarded with suspicion. The chances 
ire overwhelming against an irregular graph representing a true 


ndition. It is reported of Quetelet that when he first graphed 


his results for the heights and weights of boys and girls at suc- 


ssive ages, he was greatly perturbed at the irregularity of his 
irves around the age of puberty, particularly when he discov- 
red that the girls for about three years exceeded the boys both 


nheight and weight. According to the story, he then did a very 


scientific thing. He cooked his results by the addition of the 


records of as many tall and heavy boys, and as many short and 


1 


light girls as he could find. The tale is probably apocryphal but 
t illustrates my point. Quetelet’s feeling that the curves should 


regular was a sound one. Where he went astray was in fak- 


ng a result; he should have remained content when additional 


ilts of unselected cases did not modify the norms of his ear- 
r records. 

\ glance at the graphical representation of norms in almost 

magazine is sufficient to cast doubts on the accuracy of the 
ndardizations. For example, J. E. Wallace Wallin® in an ar- 
le entiled “Age Norms of Psycho-Motor Capacity” gives some 
phs, the irregularities of which are almost certainly due to 
perfect standardization. The addition of further results 
uld undoubtedly lead to a smoothing of the curves. 

Some years ago I gave T. A. McWhorter, one of our gradu- 

students 1n education, the task of further standardizing some 
the performance tests described in Pintner and Paterson’s 
\ Seale of Performance Tests.” Space forbids me giving all 

new standards. Table I and Figure 1, drawn from it, will 

ce for illustration. Figure 1 illustrates the changes in the me- 

curve caused by the additional cases. There is no doubt 

ll which is the better. 


‘Journal of Educational Psychology, 7:17-24, January, 1916. 
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LE I FURTHER STANDARDIZATION OF THE 
HEALY PUZZLE “A.” (TIME UNITS) 
eer PINTNER AND 
¥ . M« W HORTER 
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THE VALipity oF TEsTs 
Any one who has carefully studied the results of psychologi- 
examining in the United States Army* will have been struck 
the great diversity of the intelligence ratings there shown. 


only do the intelligence ratings differ greatly according to 


‘camps in which they were made (Part III, chapter 10), but 


y also differ according to occupational groups (chap. 15), ac- 


ling to the arm of service (chap. 16), according to nativity 


ip. 6), according to race (chap. 8), by states (chap. 5), and 
very conceivable way. Psychologists have known these facts 
general kind of way for many years, but the findings of 
holesale testings have driven the facts home as never be- 
[ven the man in the street has had his interest aroused. 
no part of my task to present these materials again. Any- 
n study them for himself, but I would like to present two 
nd a diagram in order that my subsequent argument may 
tter followed 


The editor of the Memoir gives tables of distribution by 


tes but does not analyze them. I have taken the trouble to sum- 


Table 200 which gives the alpha scores by states of Groups 


[I, white draft. These men took only the alpha test. They 


resent, therefore, the literate and more intelligent men found 
the American army. Table II gives a summary of the find- 


The table is arranged in the order of least frequency of 

le D. 
Utah is seen to head the list, but if all grades are taken into 
ideration, Washington, with the exception of the special 
of the District of Columbia, can claim to be the most intelli- 
state in the Union, closely followed by Oregon, California, 
Wyoming, Connecticut, Massachusetts, and Vermont 
tically all the Northern States are above the grade for 
tal White Draft” and practically all the Southern States are 
i New Jersey, at the bottom of the list for Grade D, is 


rkes, Robert M. Ed. Psychological Erami atin the I ted States 
Memoirs of the National Academy of Sciences, Vol. 15 Washington, 
Government Printing Office, 1921. 890 pp 
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INTELLIGENCE BY STATES 


STATES 

Utah 

California l 
Washington l 
(Jregon 2 
Ne vada 2 
Idaho 2 
Wyoming 3 
Connecticut 3 
New York 3 
Vermont 3 
Massachusetts 3 
Maine 1 
Montana 1 
Minnesota 5 
Nebraska 6 
District of Columbia 6 
lowa 7 
Colorado 7 
kK insas 7 
Pennsylvania 8 
New Hampshire 5 
Rhode Island 8 
South Dakota 9 
New Mexico 8) 
Michigan 9 
Ohio 9 
Illinois 9 
Missouri a) 
ToraL Waitt a——P ||) 
Indiana 10 
Florida 10 
Oklahoma ll 
Texas 12 
North Dakota 12 
West Virginia 15 
Wisconsin 15 
Maryland 15 
South Carolina 16 
Louisiana 19 
(Alabama 19 
Mississippi 19 
Virginia 20 
rennessee 20 
Georgia 20 
North Carolina 20 
Arkansas 23 
Delaware 26 
Kentucky 28 
New Jersey 28 
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notable exception. Kentucky and Arkansas run a close race for 
bottom place. Too much stress, however, must not be placed on 
the table as a reliable guide to the relative intelligences of the 


irious states. 
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KX LLL, 
LEGEND 
BR 2 INTELLIGENCE BY NATIVITY OF FOREIGN-BORN MEN. 
GROUPS I, I, II, WHITE DRAFT 


Now consider Figure 2, taken from the Memoirs.® The in- 


telligence of the recruits born in England is seen to be consid- 


bly greater than that of the White Draft, while that of Scot- 


Ibid. p. 295. 
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ish and Canadian recruits is also very high. Poles, Italians, 
Russians make a very bad showing. 

In the combined scale, as shown by Table III, the order is 
somewhat changed. Canada now heads the list and Italy foots 


TABLE III. 


Cinieation wee Standard Number of Mea 
. ’ Deviation Cases Mental Ag 
Canada 13.74 2.7 948 13.29 
England, Ireland, and 
Scotland 13.37 2.83 1214 13.00 
Denmark, Norway, and 
Sweden 13.30 2.41 1610 12.95 
Germany and Austria 13.17 2.69 597 12.85 
(sreece 11.90 2.57 573 11.86 
tussia 11.16 2.96 2701 11.28 
Italy 11.04 2.598 1002 11.19 


it. The southern Europeans compare badly with norther: 
Europeans and Canadians. 

Now what is the moral of all this? If a test is standardized 
on the Pacific Slope, as Terman’s Revision was, it will proba 
include more than a just proportion of the more intelligent chil 
dren. It will, therefore, set too high a standard for the United 
States as a whole and to that extent will be imperfectly sta 
ardized. Similarly if the standardization is made in a communit 
containing a large proportion of English and Canadian imi 
grants the same result will follow. Conversely, if it is 1 
in the southern States or in a community with a large propor 
tion of southern Europeans, the standardization will rate to« 

Any test, therefore, reputedly standardized for the United St 
will in future have to contain results from north and south, « 
and west. 

[f negroes are to be considered then the problem becomes sti!! 
more complicated. Table IV shows the findings of the army t 
on racial intelligence. 

The negroes show a striking inferiority in intelligence w! 
compared with whites. Further, the negroes of the Norther 
States are markedly superior to those of the Southern States 


Turning now to Canada, I have to confess at the begin 


that we are practically dependent upon the United States fo: 
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’ 
TABLE IV. INTELLIGENCE OF WHITES AND NEGROES 
Number Percent Making Grade 
tace of 
Cases D-—- | D C— 6 C+ B A 
Whites, Groups 
1, U1, IV 93,973 | 7.0 | 17.1 | 23.8 | 25.0| 15.0| 8.0 | 4.1 
Negroes, Group IV} 18,819 | 49.0 | 29.7| 12.9] 5.7| 2.0} 061! 0.1 
various tests and scales. While we are grateful for the hearty 
way in which our fellow-educators cooperate with us and render 
every assistance, some of us wonder if tests standardized in the 
United States are valid for Canada. I have not many results 
to place before you, but such as I have, lead to the conclusion 
that either we must make tests and scales of our own or re- 


standardize yours. 


Dr. Hamilton, a graduate student of the University of 


Toronto, constructed three handwriting scales to measure the 


handwriting of Ontario school children. 


This piece of work was 


peculiarly appropriate since all Ontario children are taught to 


write in the same way from the same copy books. 


It is obvious, 


however, that there cannot be a single standardization of hand- 


writing that will fit all cases. 


\. W. R. Doan, another of our graduate students, in meas- 


mewhat the Strayer 
Cy 


ings can be used, say, to 
\ 


ig the school buildings of Toronto, was forced to modify 


scale which is so largely used in the 


ates. I cannot conceive that any one scale for school build- 


measure the school buildings of Northern 


‘ew York with its severe winter and the school buildings of 


Florida where winter is unknown. 


Sansom® used the Otis tests in the Highland Practice 


School, Edmonton. 
be sufficient for me to 


Since his results have been reported it will 


allude to the fact that according to his 


results these Canadian pupils were somewhat below those of the 


‘nited States. 


The cases, however, were too few to justify 


ny generalization from them. 





‘ 


*Sansom, C. 
May, 1921. 


‘* An analysis of scores, Otis Seale,’’ The School, 9:635-45, 
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During the past two years Professor Bott and I have given 





the Thorndike Columbia test to various groups of students 








the University of Toronto, and to high-school pupils of Toront 





about to try the matriculation examination. The results for tl 


university students are given in Table V. 





TABLE V. UNIVERSITY OF TORONTO SUMMARY 
OF THORNDIKE TESTS, 1920 


New GRADUATES F > Vu 
Seconp YEAR) ONTARIO COLLEGE OF q hae Rteeran 
~ MEDICAL EDUCATION St. MICHAEL'S T 
SCORI ora 
STUDENTS Men & Men & 

Men Men | Women| Women| Men | Women| Women 

110-up l 1 l - 
105-109 .9 l 0 0 l 
100-104 9 2 2 l 3 
95-99 9 3 3 3 6 
90-94 .9 } 3 3 6 
85-899 8 6 5 11 H 2 6 2 
SO-S4.9 2 4 8 12 3 l S 
75-79 9 5 l 7 8 9 3 12 y. 
70-74.9 0 2 7 9 9 7 16 
65-69 .9 5 1 4 5 10 7 17 2 
60-64 .9 2 2 2 { 6 H 10 I 
55-59 .9 ] $ t 8 ’ 
50 54 Q l 6 l 7 S 
i549 9 1 l l 2 
10-44 9 l 3 3 : 
35-39 .9 l 1 l 
Total 37 25 10 65 56 29 85 187 
Median 85.2 88 0 79.8 83.4 | 67.6 67.2 67.6 





A comparison of our results with those of Thorndike is p1 
sented in Table VI. Some results for the Toronto high-sch 
pupils are also included. 

It is difficult to draw conclusions from these results, si 
the Toronto students include both graduates and women. Thor 
dike thinks the women are penalized to the extent of five poin' 


¢ 


by the form of the examination. If we set the low scores of t! 





—— 


women against the high scores of the graduates we find that t! 
Toronto students rate about equal to those of Columbia, Brow: 
and Rutgers. The high-school pupils were taken without sel 


na ee ee 


tion from those proposing to try matriculation the follow1 
month. The presence of girls and of those who subsequent 
failed in matriculation would naturally lower the scores. 
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. VI. 


Rutgers (Thorndike, 
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PERCENTAGE DISTRIBUTION OF STUDENTS ACCORDING 


TO THEIR SCORES ON THE THORNDIKE TEST 


Students at Brown, 


Columbia, and 


500 cases) 


1 


o 
9 


99 


26 
9 
1: 


> 
3 
5 


100 


Toronto 
Students 
(187 cases) 


100 


I 


Toronto 


High School 


Pupils 


SO Ge DP 
AOWWCO 


100.0 


(175 cases) 


Second-rate 


Colleges and 
Agricultural Schools 
(Thorndike, 500 cases) 





[his year Professor Bridges, Professor Bott, and I have 


n a modified alpha examination to several hundred students 


the University of Toronto. 


() 


The results in comparison with 


obtained at Ohio State University are summarized in 


VII. 
VII. MODIFIED 
STATE UNIVERSITY 


year students 


2nd year students 
‘d year students. 


ith year students 


Graduates 


H10 STATE UNIVERSITY 
let 


ALPHA 
AND 


EXAMINATION 


UNIVERSITY 


Medians 


OW Ot Hm bo bo 


1-1 a 
WW bo to 


UNIVERSITY OF TORONTO, MEDICAL 
Ist year students. 


2nd year students 
3rd year students 


Graduates. 








“Ibo 


CD mt feet feet 


“ 


OF 


A. D.’s 


RESULTS AT OHIO 


TORONTO 


6 
0 


Number 
of 
cases 


2021 
161 
115 
723 


51 


400 
52 
46 

118 


[In comparison with Bridges’ results for Ohio State Univer- 


Toronto students on the whole are shown to be slightly 


The results obtained by the fourth year students of 


State University should be discounted a little since they had 


rked through the same examination a year previously. 








; 
; 
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When I offered a paper last May on the standardization of 
tests, I intended to present a Canadian standardization of the 
Ayres’ Spelling Scale. Delays in printing have prevented me 


from carrying the work to a conclusion. Only the results of a 





preliminary survey can be given to-day. They are shown in 
Table VIII. Canadian pupils apparently spell better than those 
TABLE VIII. PRELIMINARY RESULTS OF AYRES’ SPELLING 
TEST IN CANADIAN SCHOOLS 


Number of} Column | Percent | Ayres’ 





School | Grade Pupils Used | Correct |Standard 
7 
I 5 34 P 89.3 79 
Il 6 30 R 88 79 
7 35 T 79.1 79 
8 35 U 83.3 84 
Ill SA t1 U&T 89.8 86 
SB 41 U&T 88.6 86 
7A 41 U&T 80 76 
7B 38 U&T 82 76 
7C 36 U&T 87.4 76 
L\ 8 17 x 96.5 98 
7 113 P 93.6 94 
6 128 P 92.1 88 
5 185 P 77.2 79 
t 138 P 64.1 66 
\ 8 106 { 86.8 S4 
7 104 T 83.2 79 
6 100 S 79.6 73 
VI S 100 U 87.8 84 
6 100 = 78 65 
VII ti 64 R 81.2 79 
S 24 { 79.2 84 
Vill 6 123 R 71.2 79 
8 SS { 73.6 S4 
| IX S 83 U 87 S4 
X 8 100 { 86.8 84 
- 
| of the United States. They ought to, for Canadian schools 
| devote about 50 percent of their time to “tool subjects”, chiefly 
i ys , , . : , 
the three R’s. As far as one can judge from study courses and 
time-tables, American schools spend only about 20 percent 
their time on tool subjects, the remainder on content subjects 
The transition from the older to the newer forms of spellings 
probably affects adversely the pupils of the United States mo ) 
than those of Canada. ; 
[ am afraid that some of the specific evidence I have p1 


sented may not sound very convincing, but it is sufficient to ind 
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of cate that general standardizations, except for special purposes, 
he ire practically useless. What we need are finer and special 
ne standardizations. We need them not by countries, states or prov- 
a inces, but by cities, wards of a city, and for each racial or social 
in croup within the wards of a city. Standardizations by grades 
Se ind by ages are also too coarse. We need them by ages within 


the grades. And even here different races and different social 

nd occupational groups should be taken into account. I feel 

nvinced that the orgy of indiscriminate testing that we have 

recently on this continent has not served our best ends. 

Especially have we been at fault in regard to interpretation. 

Tests standardized for one specific purpose in one area have 

been used uncritically for other purposes in other areas. The 

ns of college professors have been triumphantly compared 

th the sons of labourers and negroes. College professors’ 

should be compared with college professors’ sons, sons of 

urers with sons of labourers, and negroes with negroes. The 

craphical and social environments should always be taken 

nsideration. A negro of the south may not make as good 

re in an intelligence test as a Harvard professor, but as 
er of cotton he will be infinitely superior. 

In the same way an unthinking use of American tests in 

Canadian schools will lead to erroneous conclusions. Some of 

tests, such as those in history and geography, we cannot use 

Others, we are convinced, need re-standardization. Can- 

pelling should be contrasted with Canadian spelling, Can- 

n intelligence with Canadian intelligence, for in spite of the 

bility of population on this continent, most Canadians will live 


fly — ; : , 
nd die in Canada. It is on these grounds that in spite of my 





t affection for the United States and its people, I advocate, 
ison and out of season, the desirability of standardizing all 
tests and scales we use in Canada according to local Canadian 


lards and not according to any other. 


eine ae 
ee 

















THE INTELLIGENCE OF TEACHERS IN TRAINING, 
WITH A NOTE ON PRACTICE-EFFECTS WITH 
INTELLIGENCE TESTS 
SAMUEL RENSHAW 
Department of Psychology, Western State Normal School, Kalamazoo, Mich, 


I 


The belief is more or less current that schools and colleges 
devoted to the training of teachers are recruiting their student 
bodies from inferior high-school graduates. A few references 
are cited which are being quoted to sustain this view: 

Yoakum and Yerkes (1) report scores made on the Army 
Alpha Test by normal-school men and women and compare them 
with scores made by students from colleges, universities, and 
technical schools. The scores for the teachers in training are in- 
variably reported lower than the others. To quote from thei 
tables (pp. 164-171), the median score for men students from 
five normal schools is 115 Alpha points. The median for norn 
school women is 111. For college men the median is listed 
130, and for college women it is 127. 

Thurstone (2) elsewhere prints figures and diagrams show 


ing the inferiority of the median and other percentile scores for 
normal-school freshmen compared to the scores of freshmen in 
engineering and liberal arts colleges. These comparisons 
based upon scores made on the Thurstone Test IV, Intelligenc: 
xamination for High-School Seniors and College Freshmen 
Woodworth (3) makes a comparison of the frequency dis 
tributions of an army draftee sampling, which, at least by 
plication, he regards as typical, with a college freshman sampling 
\Ipha test scores form the basis of comparison. He places t 
median of the drafted men at 65, and that of the freshmen at 15 
Repeated references to such statements as the above ha 


caused many persons to be alarmed at the growing “attenuatior 


of the stock from which public school teachers are being mad 


It is the purpose of this paper to examine critically this view ar 
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offer some evidence in contrast to its position by presenting 
distribution of the Alpha scores of a principal sample (1199 
\ total registration of 1294) from the student body in the sec- 
| largest of Michigan’s normal schools. 
Table I shows the distribution of the scores. The test was 
1 6 of the Alpha Army Test, administered by the writer to 
students in two groups of about 600 each. Women students 
tnumbered the men by about two to one—a fact worthy of con- 
ration in interpreting the results, since it is generally under- 
that women tend to make slightly lower scores than men 


\Ipha. 





DISTRIBUTION OF THE ALPHA SCORES. NORMAL-SCHOOL 


GROUP 


Scores Frequency 


190-199 } 
180-189 28 
170-179 41 
160-169 100 
150-159 145 
140-149 194 
130-139 200 
120-129 | 185 
110-119 122 
100—109 86 
90-99 61 
80-89 18 
70-79 10 
60-69 i 
50-59 l 





Total ' 1199 
The true median for this distribution was computed at 
35.05; the mean was found to be 134.95; standard deviation, 
3.58; mean deviation, 18.79; probable error, 15.90. The prob- 
le errors of the standard deviation and of the mean were found 
0.32 and 0.46 respectively. The customary interpretation 
| this sort of fact (for example in the case of the P.E. of the 
would be that the means of similar groups upon repeated 


easuring with the same or an equivalent scale would in half 


findings vary not more than 0.46 above or below the obtained 
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mean. Further reference will be made to this statement in 
Part II of this paper. 

Arps and Noble (4) published the distribution of Alpha 
scores for 5950 Ohio State University students. Of this num 
ber 2545 were freshmen, 1346 sophomores, 1097 juniors, 76 
seniors, 139 graduate students and 63 were special students. In 
our group of 1199 there were 1116 freshmen and sophomores, 
36 juniors, 19 seniors, 3 graduate students, and 25 “specials.” 
The small numbers in the upper classes is due to the fact that th: 
institution has only been granting the baccalaureate degree for 
the past two years. Formerly two-year courses only were of- 
fered. The university population thus has a far greater prop 
tion of junior and senior students. This is a factor selective of 
the better grades of intelligence, and would tend to raise the cen- 
tral tendency of the university percentiles. 

Table Il shows a comparison of the deciles of the two groups 


of students. 


rABLE Il COMPARISON OF THE DECILES OF THE ALPHA SCORES, 
OHIO STATE UNIVERSITY AND WESTERN STATE NORMAL 








Percentile 0.8.U. | W.S.N. 

100 211 198 
o0 170 165 
80 159 154 
70 150 147 
60 143 141 
50 136 135 
40 128 128 
30 120 122 
20 110 115 

10 96 103 

l 61 76 

The difference of the percentile scores in the top and bottor 
fifths for these two institutions is doubtless due to the size of t! 


samples, there being nearly five times as many university stu 
dents as normal-school students. Again, the slight differences 
may be due to the larger proportional number of upperclassmen 


in the university group. So far as this evidence is concerned, | 
seems that there would be no valid difference in the relative 1 
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comprising 317 
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telligence of the two groups of students if the samples are reduced 
to the same basis of comparison. 

The figures of Yoakum and Yerkes (1) are open to objection 
on the ground that they were obtained from five of the smaller 
and younger normal schools. Moreover, except for one Penn- 
sylvania school these institutions were located in the southern and 
southwestern sections of our country. It is a well-known fact 
that among all classes of schools and colleges the student selec- 
tion and standards will vary with the different localities. There 
may be wide differences even though the space that separates two 
institutions be no greater than the width of a city street. Again, 
these samples were taken in war-time. There was assuredly a tre- 

endous attenuation during those years felt in every college and 
normal school in the country. Also, the number of subjects from 
these schools is extremely small—in some cases less than 100. We 
are not told what percents of the student bodies was represented, 
or the proportions of the sexes. Further, normal schools differ 
in entrance requirements, teaching staff, and physical equipment. 
In some of them matriculation means meeting the standard col- 
lege entrance requirements; in others, it has been said, the only 
stipulation is the physical ability to “climb the hill, sign your 
name, and pay the fee.” 

Thurstone’s (2) figures were obtained from Pennsylvania 
and Virginia normal schools. The figures are no doubt valid for 
those states. But one begins to suspect that there are special 
elective factors at work. The differences which he reports be- 
tween normal-school freshmen and arts and engineering fresh- 
men are significant. Would the same conditions obtain for states 
like Indiana, Wisconsin, Minnesota, Illinois, or Ohio? It is 
doubtful. 

Woodworth (3) places the college freshman median at 150. 
There are good reasons for believing that this is too high. Fresh- 
nen in state universities do not run that high. In 1919 the 

edian score for Ohio State freshmen was 129, the 75-percentile 


[47, and the 25-percentile 108. For twenty colleges combined 


5 
5 


freshmen it was 130. 
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Is it true that the majority of teachers in training are dray 
from the middle and lower thirds of high-school graduates ? 
reply we quote Table III, from a report by Whipple and Cobb (( 


on Alpha scores made by high-school seniors. 


BLE Ill MEDIAN ALPHA SCORES OF HIGH-SCHOOL SENIO! 
EIGHT MICHIGAN CITIES AND TOWNS 
City Number Median score 
Alma 53 121 
Milan 30 121 
Mt. Clemens 29 124 
Mt. Pleasant i8 127 
Wayne 38 110 
Y psilanti 25 127 
sattle Creek 155 128 
Highland Park 160 122 
Total 980 122.5 (Mean) 
The average of the medians of the 980 Michigan high-sch 


graduates is 122.5, which corresponds approximately to the 3 
percentile of our normal-school group and to the 34th-percentil 
of the Ohio State University group. 
| Madsen reported lowa high-school seniors to average 
128 points on Alpha, which is the 40th-percentile for our grou 
or one-tenth below the normal-school average. The distributi 
of the high-school students’ scores are unfortunately not a 
ible. From the freshman figures, however, it is evident that 
better types of normal schools and colleges are not attracting | 


weaker high-school students. 


II 


To what extent is an Alpha score a valid measure of “i 
ligence” ? What is the probable error of a single Alpha scot 
How much “error” will be introduced by the effects of practice 
taking tests of this sort? 

The Alpha with its several forms permits study of the eff 





of practice. It is reasonable to assume that a person who | 
repeatedly taken tests of this sort will make a higher score t 


the novice who is being tested the first time. If this differet 











INTELLIGENCE OF TEACHERS IN TRAINING 33 


aw found with individuals it will also be found in the case of 
ps. It would be manifestly unfair to compare two groups 
(( f pupils of like age and “‘mentality,” the first of which, say, has 
| two or three times as much experience in taking tests as the 
Under such conditions error will be introduced if indi- 
ials are to be selected for classification or comparative rank- 
r if some method such as “critical scores” is used for a spe- 
purpose. 
So far as consistency or reliability of test scores is concerned 
are several methods in common usage which can be em- 
for this determination. The Spearman prophecy formula, 
referred to as “Brown's formula” (8, 101-102) may be used 
pute the coefficient of reliability. This is supposed to tell 


the test measures whatever it does measure. It is ex 


reliability —t 
n-+ (I—n) 7, 

»is the number of repetitions of the test and r, is its self- 

ition. Pressey (9) and Mrs. Burgess (10) have pointed 

in reality it tells how consistently the subjects tend to 

he same scores in the succeeding tests of the same sort. It 

resting to see how our data concerning this part of the in 
tion behave in accord with the Spearman expectation 

Nelley (11) recommends the use of the P.E., and Ruml (12) 

resented a rank-tangential coefficient as further methods of 

g the “efficiency” of a test. Validity usually means the 

which the test correlates with some independent cri 

We are not particularly concerned with that here. We 


rested in seeing what happens when the same 


group of 
ts are given several alternative forms of the same test 
e assume that 600 of the 1199 subjects referred to in the 
part of this paper had previously taken the Alpha test two 
re times, how far would this amount of practice invalidate 


nparison of their scores with those of a similar group ser\ 





r the first time as subjects in a mental survey? 
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Dunlap and Snyder (7) repeated the Alpha four times, using 
different forms, with 44 Johns Hopkins junior and senior men 
We quote from their report: 


The relative rating on the third test is somewhat different fr 
the first. If the test had been used to select the best fourth of tl 
group there would have been little difference in the individuals selected 
since 9 of the 11 who were in the first (high) quartile in the first te 
remained in the first quartile in the third (test) while the two who ¢ 
back move but to the next quartile 
It is a matter of passing interest to note the comparat 
uniformity in the results of the first and third tests in the first (hig! 
quartile and the contrasting fluctuations of results in the fourth (low 
quartile. Were the tests given with a view to eliminating the lows 
quartile the first and third tests would thus yield quite different results 
If the men in the lower half of the class had had practice in t 
test equivalent to that actually obtained by the taking of the test tw 
nd the men who are in the upper half had not had practice, a sing 
would have given for the class a relative grading which would ha 





liffered markedly from either the first or third of the actual ratings, 


which would have been maximally unfair. ' 


The writer repeated this experiment under slightly different 
conditions. The subjects were 24 sophomore and junior student 


' 


Forms 9, 6, and 8 of Alpha were given at intervals of thr 


in a laboratory section in a course in Educational Psychology | 
weeks, with especial care to keep the incentives of the students 

ue Ae : 
uniformly high. The scholarship of these students would aver 


] 
} 


age around C. There were 5 men and 19 women. One man! 
taken Alpha previously in the “scrambled” form. The rest wer 
novices. The coefficients of correlation between the three test 


vere as follows: 


Tests r 
1 and 2 0.76 
l and 3 0.78 
2 and 3 0.86 


The mean scores of the first, second, and third tests wer« 


ees 


spectively 126.2, 153.2 and 161.7. The gain of the averagt 


~* 


test two over the average of test one was 21.4 percent; but t 


three showed only 5.5 percent gain over test two. The mean 











third test was 28.1 percent greater than the mean of the first 
st. Evidently there is a notable practice effect and it seems 
idly to become asymptotic, although we are not just sure as 
the form of the practice curve. A small amount of practice 
th Alpha seems to give a student, therefore, quite a consider- 
advantage over the novice. Suppose, for example, a student 
ikes a score of 120 on his first test. If this also gives him a 
rcent practice-effect advantage, the second time he is tested 
score should be 150. His first score would place him at the 26- 
entile of the Western Normal group and the second at the 
j-percentile—a difference of 48-percentile ranks! Table I\ 
ws the changes in the scores of the highest and lowest qjuar- 


‘f this group. 


\ CHANGES IN SCORES OF SUBJECTS IN TOP AND BOT- 





TOM QUARTILES 


ALPHA Form 
SUBJECTS > 6 2 


Top QUARTILE 
\ 


193 184 189 
B 176 180 181 
a; 165 184 192 
D 153 165 190 
k 146 167 181 
r 146 146 166 
Mean 163.1 171.0 183.1 
Percentile 89 O4 98 
30TTOM QUARTILE 
S 103 139 161 
- 97 126 146 
U 97 124 129 
V OF 129 136 
i WwW 89 142 153 
X 88 149 143 
Mean 94.6 134.8 144.6 
Percentile 5 50 65 
trom Table IV it will be noted that the low fourth of these 
‘udents make enormous gains from “practice’”—about six times 
J much on the percentile basis as the top fourth. All of the sub- 


cts show significant gains as between the first and third tests. 


is worth while to observe also that persons whose scores on 
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the first test are approximately or exactly the same show quite 
striking differences in later tests. 

These results have bearing upon the consistency of the Alpha 
Our results support and supplement those of Dunlap and Snyder. 
The importance of knowing beforehand how much previous test 
experience a subject has had before undertaking a treatment of 
his test record is emphasized. It may be shown later that true 
measures of intelligence can only be gotten in case the subjects 
have had sufficient practice with pencil and paper tests to take 
them approximately to their psychological limit of improvement 
through such practice. At any rate, before a comparison of the 


intelligence status, as represented by test scores, of any two or 


I 


) 


nore groups is undertaken this factor should be investigated and 
suitable adjustment or allowances made therefore. It 1s not un 


likely that many of the “sectional” differences between samples 





of like age and grade groups, between “superior” and “inferior” 
schools, and the like, are due at least in part to this particular 
skill in test-taking 
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STUDY OF DEPTH AND RATE OF COMPREHENSION 
IN READING BY MEANS OF A PRACTICE 
EXPERIMENT! 


ARTHUR I. GATES 
Teachers College, Columbia University 

In 1913 in discussing the frequency of improvement as the 
result of practice, Thorndike wrote: “So far as I am aware of 
the facts, no mental function has been deliberately practiced with 
in eye to improving it and with proper opportunity for the law of 

effect to operate without some improvement as a result’’.* 
There are few if any reasons for supposing that the func- 
ns with which educational and mental t~sts are concerned are 
tt similarly subject to the effects of practice. Since improve- 


ent is generally specific, the effects of practice should be dis- 

vered, lest quite erroneous notions of general growth be 
affirmed from what is merely specific improvement in the test 
itself 

With pupils of grades 111 to v1, inclusive, of the Scarborough 
School as subjects, the Burgess and the Thorndike-McCall read- 
ing tests, both of which have several supposedly equivalent forms, 
vere used as materials for a practice experiment under condi- 


tions similar to those which ordinarily obtain in investigations 


f this type. The experiment with the Burgess test ran five days, 

minutes per day; with the Thorndike-McCall thirty minutes 

er day for seven consecutive school days. Incidentally the data 

ttord the possibility of computing the reliability and validity of 

two instruments, as well as the relative difficulty of the 
eral forms of each test. 


Tue VAuipity oF THE TEsTs 
It will be advisable, first of all, to consider the validity of the 
tests. What functions do they measure? Combining the 
‘A contribution of the Department of Educational Research of the Scar 


gh School, Scarborough, New York. 
Thorndike, E. L. Educational Psychology. New York: Teachers Col 


ege, Columbia University. Vol. II. p. 151. 1913. 
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results of five trials of the Burgess and of seven Thorndike- 
McCall tests, measures of high reliability (consistency) are se- 
cured. The correlation between these two composite scores are 
as follows: grade 111, 0.90; grade Iv, 0.52; grade v, 0.48; and 
grade v1, 0.54. In grade 111, the two tests appear to measure ver) 
nearly the same abilities, but such is not the case in other grades, 
where a valid distinction between the two functions seems t 
exist. 

A considerable amount of individual work with beginners 
in reading, with exceedingly slow readers of high general intelli- 
gence according to the Stanford-Binet, and with readers of fair 
speed but less than average intelligence, has provided substantial 
evidence that (except in grade m1 or below) the Thorndike- 
McCall test measures depth or power of comprehension, in which 
rate is a minor factor, whereas the Burgess test measures ra 
of comprehension primarily. 

Table I gives samples of situations frequently found among 
bright pupils whose reading is very slow. If a pupil has a hig! 
degree of general mental ability he will earn a high score on th 
Thorndike-McCall even if his reading is mechanically very poor 
but even with great power or depth of comprehension his score 


on the Burgess will be low. 


TABLE I. SAMPLE SCORES OF BRIGHT PUPILS WHO ARE 
SLOW READERS 


. Grade Status',. 
Stanf ro > - . ‘ » Steg . 
Stanford | School | ~~ cumin, I irade Status 


Subject | 1.Q. | Grade McCall Burgess 
125 VIll 9 2 3.0 
B 122 Vill 11.2 3.3 
( 119 V 5.1 ie 
D 109 VI 6.8 3.2 
I 105 Vil 7.4 3.1 


We have found that intensive training of very slow readers 
produces marked improvement in scores on the Burgess test wit! 
out perceptible improvement in the Thorndike-McCall (except 


in grade 111 or lower). 
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dike- In grades below the fourth the two tests yield essentially the 
"e Se- same results for many pupils because the Burgess material be- 
S are mes a real test of depth of comprehension and because the 
and Thorndike-McCall scores may be limited by speed and ability 
ver in word recognition. Effective training in the mechanics of read- 
‘ades, ing—word recognition, etc.—sometimes results in an improve- 
ns te ment in performances in both tests. 

For purposes of further analyzing the group associations of 
aners reading and other abilities, the pupils of grades tv, v, and v1 
stelli- re combined, grade 11 being omitted for reasons just indi- 

fair ted. The correlations are shown in Table II. 
intial The correlation between Burgess and Thorndike-McCall is 
dike- -1, but when differences in chronological age are eliminated 
vhich by partial correlation, it becames 0.59. This is a substantial 
rate rrelation, indicating a fairly close association of rate and depth 
comprehension in general. This fact in no way contradicts 
nong | the findings presented above. The two tests measure essentially 
hig! different even if correlated abilities; in other words, individuals 
n th high in one and low in the other are found but they are few. A 
oor ficient of 0.59 allows for a great deal of irregularity.* 
score 
TABLE II. CORRELATIONS. GRADES IV, V, VI, 
COMBINED. (i= 58) 
| (a) Simple Correlations 
Burgess | — Stanford) Life 
McCall M. A. Age 
1. Burgess eee a 0 71 0.56 0 40 
2. Thorndike-McCall..| 0.71 0.73 0.58 
3. Stanford M. A. 0.56 0.73 0.67 
| 4. Life Age... 0.40 0.58 0. 67 
| (b) Partial Correlations, First Order 
_ r 
Burgess with Thorndike-McCall (Age eliminated) 0.59 
AC Burgess with M. A. (Age eliminated) 0.41 
wit! lhorndike-McCall with M. A. (Age eliminated) 0.57_ 
cC 


*The correlation 0.71 is higher than those reported for the grades sepa- 
’ for the reason that the range of ability in the single grade is much 
8 wide. 


ratal 








: 
: 
' 
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As shown in Table II, the correlation of the Thorndike- 
McCall with the Stanford-Binet mental age is practically the 
same as that between the two reading tests. The association of 
Burgess with mental age is considerably less. The import of th 
correlation of Thorndike-McCall with mental age will be con 


sidered later 


THE INFLUENCE OF PRAcTICE Upon RATE OF READING 
4s MEASURED BY THE BurcEss TEsT 
In order that the effects of practice might not be obscured 
by inequality in the difficulty of the several forms of the tests 
(although they are supposed to be of equal difficulty), a revol 
ing schedule of practice was arranged. Each grade was broket 
into four groups, with the forms and practice distributed 


follows: 


Forms Usep on Inpicatep Days 


Grout First |Second| Third | Fourth! Fifth 
day day day day day 
I l 2 3 t l 
I] 2 ; 4 l 2 
Ill } 1 l 2 3 
1\ t l 2 3 i 


Differences in difficulty of the forms were thereby neutralized 


because all four forms were used each day. The final averag 
for each grade is an average of the means for the separate groups 
thus giving equal weight to each form and each group. 

Table III giv es the results of five practice periods of fir 
minutes each on successive days. The improvement, resulting 
from about twenty minutes practice (from the middle of tl 
first period to the middle of the fifth) averages about fiftee: 
percent. The figure is perhaps a trifle smaller than would | 
obtained from certain other functions such as arithmetic or cai 
cellation, but it is nevertheless considerable. The improvement 
is specific; quite certainly rate of comprehension in general | 
not been improved to an equal degree. For that reason, certain 


cautions should attend the use of such a test as a periodic measur 








ey ee 
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dike- f improvement in reading. Grade and age norms as published 
y the re doubtless based on results of tmitial tests. Repeated use of 
mn of Burgess test may well give a quite fictitious notion of general 
f tl progress in terms of such norms. Although it may be that tests 
con given at intervals of a month or semester will not produce im- 


vement as great as when given on successive days, some dis- 
int for specific adjustment must be made. Among the entirely 


TABLE IIl. PRACTICE EFFECT. BURGESS TEST 





“ul l First Second Third Fourth Fifth 
day day day day day 
tests - 
, Grave Ill 
ve . Me in Score t 1 +. 0 { 2 } 4 4.5 
ol . Grade I quivalent 3.05 3.0 a8 3.20 3.20 
= Percent 100 98 102 107 110 
d 
aDE I\ 
Mean Score 7.3 7.4 7.8 8.3 8.9 
(jrade Equivalent + SO 1 9 5.3 5.8 6.4 
Percent 100 101 107 114 122 
(;RADE \ 
Mean Score 9.2 9.5 9.2 9.3 10.5 
Grade Equivalent 6.7 7.0 6.7 6.8 8.0 
Percent 100 103 100 101 114 
RADE VI 
Mean Score 13.2 13.3 13.2 14.6 15.2 
Grade Equivalent 10.7 10.8 10.7 12.1 12.7 
i Percent 100 101 100 111 115 
liz - 7 
LEAN SCORI 8.5 8.6 8.6 9 2 9 8 
ra PERCENT 100 101 101 108 115 
; ted, improvement from practice will almost certainly be 
ter than that here disclosed for the reason that our pupils 
| ‘ 2 ° ° ° 
' e had an unusually large amount of practice in various tests, 
Iti : Se . 
-— uding previous trials with forms one and two of the Burgess 
ea i “ ; 
ftes | 
d L PRACTICE EFFECTS IN POWER OF COMPREHENSION AS 
cal MEASURED BY THE THORNDIKE-McCALL TEsT 
lI ur forms of the Thorndike-McCall test were distributed 
+4 ng four groups of pupils in each grade. The arrangement 
Le 


vas similar to the one illustrated above for the Burgess test, 
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except that seven practice days, thirty minutes per day, were 
provided. Since, however, but four forms were used each day, 
the differences in difficulty of material were not altogether 
eliminated. 

Table IV shows that seven days of practice produced no 
measurable improvement, a fact in conspicuous contrast to re- 
sults ordinarily obtained in such experiments. The variability 
of performance from day to day was determined primarily by 
differences in the difficulty of forms (forms 7 and 8 being spe- 
cially difficult); and when allowances for these differences arc 
made, the practice curve for seven 30-minute periods is nearl) 
flat. 

The implication of this result is that the power of compre 
hension of printed words, among those mechanically able to re: 
is constantly practiced to its maximum; a maximum determi 
by the general mental maturity at the time. It may be that pra 
tice sufficient to develop maximal power of comprehension 
supplied by the ordinary experiences of home and school. Ever 
intensive specific practice produces no further increase in t! 
ability; further progress depends entirely upon growth. 


TABLE IV. PRACTICE EFFECT, THORNDIKE-MC CALL TES 


First | Second | Third | Fourth} Fifth | Sixth |Sevent! 


day day day day day day day 

Grape III : 

Mean Score 35.2 | 36.7 36.8 | 33.6 (33.3 34.3 | 34 a 

Grade Equivalent 3.70} 3.95 3.97) 3.43 | 3.40 3.55) 3.96 
Grave IV 

Mean Score 412.1 | 42.7 $3.2 | 41.0 39.9 | 40.3 | 41.' 

Grade Equivalent 4.85) 4.95 5.03) 4.67 4.46) 4.55) 4.) 
GRADE V 

Mean Scor 51.8 | 52.6 | 50.5 | 48.5 | 48.6 | 49.0 | 50.56 

Grade Equivalent 6.47, 6.65 6.25) 5.92 5.93) 6.00) 6.2 
Grave VI 

Mean Score 58.3 | 58.7 57.9 | 56.4 57.5 | 57.9 | 59 

Grade Equivalent 8.08) 8.18 7.98) 7.60 7.88) 7.98) 8.25 


Graves III-VI | 
Mean Score 16.9 | 47.7 | 47.1 | 44.9 | 44.8 | 45.4 | 46 
9.6 5.i 5.30! 5.40! 5.58 
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Increase in the power of comprehension may depend upon 
the growth of native ability, which like height may be conceived 
to be determined by inner development independent of environ- 
mental factors save a sufficiency of food, exercise—ordinary 

ealthful living—or, it may depend upon knowledge, breadth 
information, and experience. In either case specific practice 
in the tests would be expected to produce little or no improvement. 

Either conclusion, however, may be an incorrect explanation 

f the results. It may be that the units of measurement are so 
arse that real improvement was made but not measured. Each 
init in the test is equal to an age difference of from three to six 
ionths (the units among the highest scores are the equivalents 
nearly two years). While it might seem quite reasonable to 
expect that three and one-half hours of specific practice would 
equal three months or more of general experience, the fact 
is that even smaller amounts of specific practice in other func- 
ns do so, as we have already observed in the case of the 
Burgess test. We need, however, more intensive study with 
ore minute scale units. 

The correlation between scores on the Stanford-Binet and 
the Thorndike-McCall was found to be high. Since the 
Chorndike-McCall has carefully constructed Reading Age 
norms,* it will be instructive to compare the reading quotients 

reading age divided by chronological age) with the intelligence 
quotients (mental age divided by chronological age). Among 
pupils, the R.O.’s give a higher median (128 compared 
122), a wider interquartile range (17 compared with 14), 
nd a wider total range (72 compared with 50). The R.O.’s 
depart widely from the I.Q.’s in particular cases, being higher 
» cases, lower in 19, and the same in one. It is quite clear 
it despite the substantial correlation between these abilities, 
‘ quotients may not be used interchangeably. It is also true, 
lthough statements have been made to the contrary, that read- 


r ¢ 


ng quotients very much higher than intelligence quotients may 


M Ca I, W. A. Tlou to mecsure tn education. New York: Mac Millan 


ny, 1922. p. 73. 
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be obtained; in fact, among our pupils the R.Q. is higher on 
the average in two out of three cases. 


THE RELIABILITY OF THE TESTS 
The Thorndtke-McCall Test.—The criterion is the sum of 
the scores from seven forms of the test. The correlations based 





upon 64 pupils of grades iv, v, and vi between one or mor 
tests and this composite are as follows: for one test, 0.84; for 
two tests, 0.90; for three, 0.93; for four, 0.95; for five, 0.96 
and for six, 0.98. The correlations are sufficiently high to indi 
cate very great stability of relative position among pupils wher 
measured by different forms, especially if two or more forms ar 
used. These data are, however, likely to be misleading if on 
is inclined to conclude that the uniformity of association in 

group embracing three grades implies a security for the commor 





practice of transmuting test scores into grade norms for the pur 
poses of measuring individual or even grade progress durin; 
short periods. 

By referring to Table IV and noting for each grade th 
highest and lowest grade equivalents, the reader will find that 
even when the large inequalities of the various forms 
considerably reduced by using four different forms in each test 
each grade as a whole shows a range of a half year or more | 
between the extremes of the several tests. Variations from test | 
to test will be larger than those indicated if a single differert 
form is used at each trial. Since the various forms were dis 
tributed among the practice periods in such a way that practic 
effects would be fairly well equalized, even if they existed (whi 
they apparently did not), the data of Table V show discrej 


cies which will occur in repeated tests due to inequality of th: 
Ian, 


forms. If seven different forms are given on successive 
and the scores transmuted into grade status, the average results | 
for grade 111 vary over a range equivalent of 0.71 of a scl 


vear; for grade iv, 0.66 of a school year; and for grad 


and v1, 0.86 and 2.5 years respectively. Forms seven and eight! 
are especially difficult; Forms 2, 3, 5, and 6 are pretty unit 











er on 
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in difficulty. While the tests have been carefully constructed 
and equated, the coarseness of the units gives even slight differ- 
es in difficulty a greatly magnified importance when trans- 
muted into grade levels. 
In order to determine the variability of performance of 
single individuals, with inequalities of forms fairly well elim- 
ted, the data were assembled as follows: For each individual 


rABLE V. SCORES AND GRADE EQUIVALENTS FOR DIFFERENT 
FORMS OF THE THORNDIKE-MCCALL TEST 


ek 
Form) Form) Form! Form Form Form) Form) minus 
1 2 3 5 6 7 8 lowest 
Grape III 
Mean Score ..|89.0 136.9 135.7 |36.6 |36.7 |32.1 |31.8 
Grade Equivalent. .....| 3.65) 3.95) 3.84) 3.93] 3.95) 3.3 | 3.25) 0.71 
Grape IV 
Mean Score 42.3 |42.6 /41.6 |43.0 |42.6 /41.2 |38.6 
Grade Equivalent 4.88) 4.93) 4.77) 5.0 | 4,93) 4.71) 4.33) 0.66 
ZADE V 
Mean Score 50.0 |52.9 [52.5 |51.3 |50.7 |48.4 |47.9 
Grade Equivalent 16.2 | 6.7 | 6.6 | 6.4 | 6.3 | 5.92) 5.84) 0.86 
RADE VI 
Mean Score 59.1 |59.1 (61.7 [57.4 |58.7 (56.4 [54.6 
Grade Equivalent 8.25) 8.25) 9.7 | 7.75) 8.2 | 7.7 | 7.2 2.5 
MEAN Score . 146.6 |47.9 |47.9 |47.1 [47.2 [44.5 [43.2 


computed the average score for the seven tests, and with 

this the score from the first test, the average of the first two 
the average of the first three, etc. were compared. The 
leviations from the average of seven tests thus secured were 
veraged by grades. The results are shown in Table VI. 
\ssuming that the average of seven tests is a perfect measure, 
the average individual deviates from it by 0.66 of a school year 
when he takes but one test, 0.41 years when he takes two tests, 
38 for three tests, 0.32 for four, 0.24 for five, and 0.16 for 
six. The practical worker must consider the number of tests 


ee a ae ; 
eeded for his purpose. To measure the annual improvement of 


n 


individual one or two tests will suffice but to measure monthly 


improvement six tests at each examination are scarcely suff- 
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TABLE VI. THE AVERAGE DEVIATIONS FROM THE 


SCORE IF THE FIRST TEST, THE FIRST TWO TESTS, 


FIRST THREE TESTS, ETC. ARE CONSIDERED. 
THORNDIKE-MCCALL TEST 


Number of Tests 


l 2 3 4 5 

Grave IV 

Scale Units 3.5 1.8 1.4 1.5 1.1 

School Year 0.6 0.3 0.23) 0.25) 0.18 
GrRAvE V 

Scale Units 3.1 aia 2.2 1.4 0.9 

School Year 0.6 0.44 0 44 0 28 0.18 
Grape VI 

Seale Units 3.2 2.0 1.9 1.7 1.5 

School Year OS 0.5 | 0 48 0 42 0.37 
MEAN 

Scale Units 3.3 2.0 1.8 1.5 1.2 

School Year 0.66) 0.41} 0.38) 0.32) 0.24 


Vol. 7, Ne 


COM POSIT} 
THE 


TABLE VII SCORES ON DIFFERENT FORMS OF THE BURGESS TES 


PRACTICE EFFECTS ELIMINATED 


' Form | Form Form Form 
] 2 3 4 
Grape III 
Mean Score 3.1] 5.4 $4 5.0 
Grade Equivalent 2.6 3.7 2.8 3.5 
Grape IV 
Mean Score 7.9 9 6 6.5 7.5 
Grade Equivalent 5.4 7.1 1.3 5.0 
GRADE V 
Mean Score, 9.5 12.3 8.2 8.4 
Grade Equivalent 7.0 9.8 5.7 5.9 
Grave VI 
Mean Score 14.1 15.8 13.1 12.5 
Grade Equivalent 11.6 12.4 10.6 10.0 
Grapes III-VI 
Mean Score 8.7 10.8 7.8 8.4 
Grade Equivalent 6.2 8.3 5.3 5.9 
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a cient. If his purpose is to measure the progress of a grade as 
eT whole, fewer tests are required provided several forms are 
used at each test. A good method is to employ the same forms 
at each test. For example, if three tests are to be made annu- 
lly, give each third of a class a different form at the first test, 
use the same forms but give them to a different third of the 
lass on the second and third tests, thereby eliminating differences 


in difficulty among the forms. 
The reliability of the Burgess Test.—Since all four forms of 
Burgess test were used in each of the five trials, the influ- 
ence of practice is equal for each form. Table VII shows the 
lative difficulty of the forms in terms of the number of para- 
raphs read and in terms of the grade equivalents. The same 
ils secure on Form 2 a score equivalent to three grades 
cher than that earned on Form 3. This means that semi- 





nual or even annual progress cannot be adequately measured 
using different forms at each test. In ordinary work, the 
ffects of specific practice on the tests, would be added to the 
repancy here shown. 
The variability of the performances of an individual on this 
is discouragingly great. Table VIII gives as samples the 
res obtained by the five pupils first in the list of Grade Iv. 
ject I, reads 10 paragraphs in one test and 4 in the next; 
bject 2, ranges from 7 to 10; subject 3, from 3 to 6; and 
bject 4, from 10 to 17. 
From such data as shown in Table VIII, the average score 
each individual and the average deviation of his scores 


TABLE VIII. SCORES OF THE FIRST FIVE PUPILS OF GRADE IV 


Scores of first five pupils 


Day Form 

2 3 4 } 

I 1 6 8 5 11 5 

; 2 2 10 10 5 12 6 
3 3 4 7 3 10 5 
4 1 2 7 5 15 6 

5 9 8 6 17 5 

Mean Score 8 5 13 5 


A. D. from 
Mean 2.6 0.8 0.8 2.4 0.4 
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from his mean were computed, as shown in the last two lines 
Averaging these two lines for each grade, we have Table IX 
[f we give the typical individual of grade Iv, v or vr five tests 
on succeeding days, half of the single scores will differ fro 
the average of all scores by an amount equivalent to a grade and 
a half or more. For grade ur the amount is less, half a grad 
Measuring monthly or semi-annual progress of an individual by 
a single test is out of the question. 
The only remedy, taking the Burgess tests as they are, is t 

use two or more forms. In Table X are shown the averag: 


deviations from the mean scores of five tests when a single test, 


rABLE IX rHE AVERAGE DEVIATION OF THE TYPICAL PUP! 
SCORES FROM THE MEAN SCORE OF HIS FIVE TESTS. 
BURGESS TEST 


Grade 
Il IV V VI 
Mean Score } 3 7 9 9 7 13 9 
\. D. from Mean 1.0 1.2 1.8 1.5 
Grade Equivalent of A. D 0.5 1.2 1.8 1.5 


TABLE X THE AVERAGE DEVIATIONS FROM THE COMPOSIT! 
SCORE ( FIVE TESTS). BURGESS TEST 





: AVERAGE DEVIATIONS FOR 
MEAN 
SCORE 1 2 3 { 
5 Tests | Test | Tests | Tests | Tests 
Grape III 
No Paragraphs { 3 l 0 0.6 0.3 0 2 
School Years 0.5 0.3 0.15) 0.1 
Grave IV 
No. Paragraphs 7.9 1.2 0.8 0.7 0.5 
School Years 1.2 0.8 0.7 0.5 
GRADE V 
No. Paragraphs 9.7 1.8 1.7 0.6 0.3 
School Years 1.8 :.7 0.6 0.3 
Grape VI 
No. Paragraphs 13.9 15 1 1 0.7 0.3 
School Years 1.5 1] 0.7 0.3 


Mran NuMBER 
PARAGRAPHS 1.4 1.05} 0.57) 0.32 
ScHoot YEARS 1.25| 0.97) 0.54! 0.3 
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1es the average of two tests, etc. are obtained. For a single test 
LX deviation is 1.25 school year; for two tests, 0.97; for three 
ests s4; and for four 0.3. The average of all four tests is no more 
Ol reliable than measures of semi-annual progress demand. 
Because individuals differ so widely in reading ability the 
cle elative positions are fairly maintained in different tests by the 
| by Burgess, even if the gross scores for each vary so much as to 
ke it difficult to locate a pupil’s grade status. Using the sum 
st f the scores for five tests as the criterion the correlation of 
rag ne test with the criterion is 0.86; of two tests, 0.92; of three 


test, ts, 0.95; and of four tests, 0.96. 




















THE INDIVIDUAL LABORATORY VERSUS THE DEM.- 
ONSTRATION METHOD OF TEACHING PHYSICS 


E. W. KIesLer 
Hillsdale High School 
AND 
CLIFFORD Woopy 
University of Michigan 
The purpose of this experiment is to set forth the results of 
an attempt in the Hillsdale high school (Michigan) to evaluat 
the merits of the individual laboratory method and the demon 
stration method of teaching physics. In the individual labora 
tory method each student or group of two students perfor 
each experiment while in the demonstration method the in 
structor, with the aid of one or two students, demonstrates the 
experiment and the students get its import through observatior 
and discussion rather than through actual performance. No di! 
ference is manifest between the two methods in the early part oi 
the experiment. With both methods the same preliminary read 
ing assignments are made and when the classes assemble the sanx 


type of short quizzes are given to test the effectiveness of thei 


reading and their understanding of the new terms of the experi 
ment. It is from this point on that the procedure with the tw 
methods is different. 

With the individual laboratory method, each student begins 


: 
to study the experiment as described in the laboratory manual Jf 
| and prepares a “temporary sheet” embodying a definite statement 


; 


of the object of the experiment, a list of the apparatus to be used, 





and a table suitable for recording the data to be obtained. A/ter qt 
the “temporary sheets” have been prepared, a quizz is given on 
“methods of performance” and special emphasis is placed on ne 
essary precautions and possible sources of error. The students 

now pass to the laboratory and individually or in pairs perforn ¢ 
the experiment, record the necessary data, make the required ; 
mathematical calculations, and write up the “temporary discus . 
sions.” Later, after the “temporary sheets” have been correcte: ; 


50 
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d the general errors have been discussed in class, each student 
writes up the experiment in permanent form. 
With the demonstration method, after the short quizz on the 
ssigned readings and new terms, the instructor announces the 
periment for the day. He then asks each student to write on 


“temporary sheet” the purpose of the experiment. He ques- 
ns the students concerning the apparatus needed and each lists 
necessary pieces. Through more questions he develops the 
nethod of procedure and emphasizes necessary precautions and 
ossible sources of error. Then in the presence of the class and 
ith the assistance of one or two members he performs the ex- 
ent. [ach student copies the data which he writes on the 
ird, makes the mathematical calculations from them, and com- 
tes the required “temporary discussions.” Later as with the 
oratory group, when the “temporary sheets” have been cor- 
| and the errors discussed, each student writes up the experi- 

nt permanently. 
hus with the two methods the same assignments are made 
he textbook, the same references are consulted, the same dis- 


ions precede and follow the experiments, and the same “tem- 





et ry’ and “permanent” write-ups are demanded. The main 
rt erence between the methods is that one group prepares the 
W rary sheets” from the laboratory manual and individually 

pertorms the experiments while the other group develops the 
‘ins | thods of procedure in class without a laboratory manual and 
u erves the performance of the experiments by the instructor 


| one or two students. 


von 
° are 


in attempting to evaluate these two methods of teaching 


. o 


iter liysics, the subject matter embodied in fourteen experiments on 
or the topic of “heat” was taught to one group of students by the in- 
1e( . individual laboratory method and to the other group by the dem- 
nt nstration method. The two groups consisted of most of the 
rt : students regularly taking physics and were equated on the basis 
ired | | scores on the Army Alpha Test. The average score for one 
cus lp was 122.82 points on the Army Alpha Test and for the 


ther group, 122.94 points. Each group contained good, average 


, 
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and poor students, but only those whose attendance was perfect 
and whose attitudes were conducive to good work. 

The fourteen experiments emphasized in this investigation 
were as follows: 


o determine a source of heat. 
he liquid and air thermometers. 
oO t the fixed points on a centigrade thermometer. 


o determine the specific heat of a metal. 
o construct a curve of cooling through change of state. 
o determine the heat of fusion on ice. 


forr 
( 


T 
TI 
ie 
1. To determine the coefficient of linear expansion. 
T 
T 
T 
Te 


determine the effect of dissolved solids on the tempera 
of liquids 
9. To determine the heat of vaporization of water. 

10 To ascertain dew point. 

To compare the conductivity of metals. 
12. To show the poor conductivity of liquids. 

13. The laws of radiation. 

14. To determine the mechanical equivalent of heat. 

With the first seven of the above experiments, the individ 
ual laboratory method was used with one group “X” and 
demonstration method with the other group “Y,” but with th 
last seven experiments the methods were reversed. 

Three different types of tests were given in the attempt 
measure the effectiveness of the two methods: (1) tests for te 
porary or immediate knowledge of the facts of the experimer 
(2) tests for permanent or delayed knowledge; and (3) a 
for knowledge of how to apply the principles and technique 
learned in attacking a new problem. In testing for temporary or 
immediate knowledge, an informal test was given to each gt 
from one to two weeks following each experiment. In testing 
lor permanent or delayed knowledge a general test over the « 
tents of the first seven experiments was given two weeks ai 
the completion of the seventh experiment. A similar test was 
given over the contents of the last seven experiments two weeks 
atter the completion of the fourteenth experiment. In the cas 
of two of the experiments, as a variation to this method of tes! 


ing for immediate and delayed knowledge, the tests for imme 


knowledge were given upon the completion of the “tem; 












rect 
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discussions” and were given again two weeks later after the 


riments had been permanently written up. 
1 the test for knowledge of how to apply the principles and 
nique learned, the students were confronted with a new prob- 
, viz., “To find the temperature of a white hot body.” They 
re furnished with a list of the apparatus needed for the experi- 


nt and were then given an informal test in which they were 


sked to make a simple drawing showing how the apparatus 


uld be used and to fill out broken sentences describing a pos- 
le method of procedure. Each student in the individual lab- 
ry group then performed the experiment while in the other 


up the instructor gave a demonstration. Two weeks later 


th groups were rigorously tested again. 


\ll tests used in attempting to evaluate the two methods might 
termed informal tests. They were, however, as nearly ob- 
tive as possible, and they embodied many of the principles util- 
| in the construction of standardized tests. Much use was 
de of the “completion test,” the “matching test,” the “true and 
se test,” and the “‘best answer test.”” A few abbreviated sam- 

will make clear the nature of the tests and will indicate 

accuracy and the thoroughness with which the work was 


I al sed. 


SAMPLE I 


words at the left are close ly related to some expression at the 
In the parentheses before each word place the number of the ex 


which you think is most closely related. 
xpansion 1. One one-hundredth the distance between the 
freezing and boiling points on a centigrade ther- 


mometer 


The number of units of heat required to 1 
] + . ‘ ] 
the temperature of one unit mass one degre 
. . . | 
gree 3. Rise of mercury in a thermometer 
»pecific Heat 4. Loss of heat by copper beaker to the 
a a - oT — ' a o_o nd 
uation 5 Che difference between the accepted value a1 


the obtained value 
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SAMPLE II 


Complete the following statements: 
I. —— is a form of molecular energy. 


2. The paraffin melted at ——————— points because the wires « 





Wy = -——-——_— 


SAMPLE IIIT 


Some of the statements concerning humidity are true and some 
alse If the statement is true, draw a line under TRUE. If it is 
draw a line under FALSE 


Warm air always contains more moisture than cold air. TRUE FA 


SAMPLE I\ 


1 


Place a check mark (1 ) in the parentheses at the left of the 
ment that best completes the sentence 


. 1 | ‘ + : r os - 
l'in-plate tea-kettles often have copper bottoms because 





( ) They will not rust so easily. 
( ) Tin plate does not burn out or rust out so easily. 
) Copper being a soft metal is more easily joined into a 


seam around the bottom edge. 


( ) Copper is a better conductor of heat. 
SAMPLE V 
| Complete the following data: 
Temperature of the room 19.0 degrees centigrad 
Mass of calorimeter 75.5 grams 
Mass ot water and calorimeter 218.0 grams 
Initial temperature of water 6.0 degrees centigrad 
Final temperature of water 33.0 degrees centigrad 
Mass of water, calorimeter, and steam 225.0 grams 
Initial temperature of steam 00.0 degrees centigrad 
Heat of vaporization calories 
Accepted value calories 
Error --— 
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SAMPLE VI 





The drawing at the 





left represents a hot 





water heating plant in 
the winter with no fire 
in the boiler. The level 
of the water in the 








plant is represented by 
the line “A” under 
these conditions. Draw 
a line parallel to “A” 
to indicate the level of 





the water in the plant 





in July (no fire) pro- 





vided no water has 
been added and none 
removed Label this 


line “B.” Indicate by 


> 
ail — another line parallel to 
> < ‘ 








" 
emeuticnenmenend’l 
————} 

bt 

2 
meh eal 1 
MS 




















, J > “A” the level of the 
water in winter with a 
—_—---=--> hot fire in the boiler 
> q 
' | and with no water hav- 
' int: ; W been removed or 
seat eae neta 

Ziti it . 4 added. Label this lin 

; - § oO | | 
pposite tne numopoer 
Pt! lasail : 
{ 3 “1” write the name of 











this part of the plant 
f this part of the plant 
he points “x,” “y,” “z,” and “w” indicate by arrows the direc 


he number “2” write the name « 
which the water would circulat« 


] 
| 


lable I, exhibiting the results of the tests for immediate 
wledge in the fourteen experiments, shows that the mean score 
the demonstration method was 60.52 percent correct; with 
individual laboratory method, 59.66 percent correct. In the 
seven experiments the group with the demonstration method 
s superior in five experiments and inferior in two experiments. 
e second seven experiments, the group with the demonstra- 
method was superior in three and inferior in three experi- 
nts while in one experiment the scores for the two methods 
re the same. It is interesting to note that those using the 
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TABLE I MEAN PERCENTS ON TESTS FOR IMMEDIATE KNOWL 


Demonstra- Demonstra- 


Number of Laboratory Number of Laborat 
tion in 3) : - tion : 

i-xperiment Group “x” | Group “‘y Experiment Group “y” Group 
l 2.6 74.01 S 76.81 75.00 

2 79.8 70.00 9 56.80 66 | 5t 

3 51.8 14 17 10 36.02 40 

t 44.14 53.00 11 79.28 79.28 

5 53.17 15.60 12 59.50 61.10 

6 43.84 43.27 13 71.49 70.73 

7 43.39 14.10 14 72.73 638. 43 
Mean 56.39 53.49 Mean 64.66 65.87 


demonstration method during the first seven experiments wet 


more successful with the laboratory method during the last s« 
experiments. The apparent superiority of this group cannot 
charged to superiority in intelligence for, according to the int 
gence test, the two groups were equal. This at least shows t! 
the demonstration method has not been a handicap to those 
dents. It should be added that the individual laboratory me 
is superior in those experiments which are difficult to det 


strate. Experiment No. 14 on “Determining the Mechani 


Equivalent of Heat’’ proved to be very difficult for the students, 
but the procedure was easily seen by them and consequent 


the demonstration method gave superior results. In experiment 


No. 4 on “Determining the Coefficient of Linear Expansion” 


was almost impossible for the class to observe the micrometet 


and consequently the individual laboratory method gave super! 


results 


rABLE Il MEAN CORES FOR TESTS FOR PERMANENT KNOWLI 
GIVEN 


Demonstration | Laboratory 


lest two weeks after completing 


first seven experiments 60.3 61.6 
Test two weeks after completing 
second seven experiments 56.8 57.0 


Mean for both tests 58.51 59.3 








' 
' 








et 
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ble II, showing the mean scores on all tests for permanent 


lve, shows a slight advantage for the individual labora 


) 


od, although the advantage is so slight that it is of little 


uence 


le II1l, which compares the mean scores made with the 


7 
| 


ods on the test given immediately after the temporary 


d been con iple ted and repeat ed two weeks after the ex- 


d been written up, shows higher scores for the dem 
method in three of four possible comparisons. The 
res in the first tests with the demonstration method 


that the facts of the experiment are more vividly por 


in with the individual laboratory method. The fact that 


p using the individual laboratory method made much 


cl ‘ 


MEAN SCORES OF TESTS FOR IMMEDIATE KNOWLEDGI 
IN COMPLETION OF TEMPORARY SHEET AND OF TEST 
MANENT KNOWLEDGE GIVEN TWO WEEKS LATER AFTER 


RIMENT HAD BEEN WRITTEN UP 


DEMONSTRATION SCORES LABORATORY SCORES 
- First Test | Second Test | First Test | Second Test 
7 40 2 13.4 36.0 14.1 
14 62 7 t. es is O 68.4 
in the second test than did the group using the demon 


dis more evidence of the initial superiority of the 


tion method. The gains shown on the second test by 


J 


test to the value of permanently writing up th 
1 . 1 . 1 

\V, showing the mean scores obtained by the two 

n confronted with the task of solving a new problen 

MEAN SCORES ON TEST FOR KNOWLEDGE OF HOW TO 


APPLY PRINCIPLES AND TECHNIQUE 


Demonstration Laboratory 
(;roup “‘x (,;roup “‘y 
n method or procedure 57 86 51.7 
iulter performance of 
periment 77.58 75.4 
ns ; 19.72 23.7 
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when only the list of apparatus was given, indicates that the 
group taught by the demonstration method is superior on the test 
on method of procedure before the experiment was performed 
and on the test after the performance of the experiment. This 
fact seems to make clear that the group using the demonstration 
method has as much ability in attacking new problems as the 
group trained with the individual laboratory method. 

On the basis of the foregoing data, the following observations 
seem justified : 

1. The results secured through the use of the demonstration 
method were as good, if not superior, in all three types of tests 
given—the tests for immediate knowledge, for permanent know/- 
edge, and for knowledge of how to apply principles and technique 
in solving a new problem. While the advantage in favor of the 
demonstration method was small, it was very significant. 

2. The individual method tended to be superior in those ex 
periments that are especially difficult to perform or in which great 
care must be exercised to see the exact procedure. Such facts 
suggest that the most effective method depends upon the natur 
of the experiments themselves and suggest the need for scier 
tifically classifying them. 

3. When the demonstration method gives equal or super! 
results, it is to be preferred to the individual laboratory metho 
because it saves about one-half of the time usually devoted to per 


forming the experiments and permits the instructor to use | 
time thus saved in relating the facts and principles to allied 
phenomena. Furthermore, the enthusiasm of the class working 
together is most valuable. 

4. New problems involving principles and technique already 
learned arouse much interest and enthusiasm and offer oppor- 
tunity for rich returns in teaching. 

5. The results of the experiment suggest that, in the smaller 
high schools at least, better teaching would result and muc! 
money would be saved if the laboratories could be arranged and 
equipped so as to facilitate demonstration of many of the ex 
periments instead of trying to provide apparatus for the individ 
ual performance of all of them. 
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\N UNRECOGNIZED ABILITY IN TEACHING 
What do you mean by a good teacher? If answers to this 
mn could be obtained from all the readers of the JouRNAL 
EDUCATIONAL RESEARCH, their variety would no doubt be 
great. And if to these replies were added the more formal 
swers of the score-card makers—Boyce, Elliott, Landsittel, 
Rugg, et al_—surely we might then expect to have in 
d every item upon which an estimate of teaching ability could 
nably be based. We should certainly find frequent mention 
rsonality, scholarship, method, discipline, leadership, and 
ration. Even voice, good looks, and sense of humor would 
ndantly represented; while those who look to the pupil 
than to the teacher for the real measuf of teaching 
ild name a multitude of desirable knowledges, skills, activi- 


1 
i 
i 


ideals, appreciations, and attitudes which good teaching 
ld develop. 
is probable, however, that no one would include in his list 
item having to do with the number of pupils a teacher can 
ssfully instruct. We are content to list the qualities which 
tion good teaching without inquiring how many pupils can 
ffectively influenced by these qualities. We estimate the 
of teaching without taking account of the number of 
who exhibit these results. Is it too much to say that if 
teacher can teach twenty-five pupils while another can teach 
equally well, the latter is worth twice as much as the 
er? And if he is worth more, should he not be better paid: 
That differences exist among teachers in respect to the num- 
f pupils they can teach successfully is certain. We should 
this to be true from all we know of individual variation 
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in other respects. Moreover, these differences are matters of 
common observation. 

We lately observed the teaching of a class of about seventy 
pupils. The exercise was definite, interest was strongly aroused, 
the attention of all the pupils was engaged, and their intellectu 
participation was evident. It was not a lecture, but a series 
questions, answers, and discussions in which everybody took part 
not merely when reciting but through active listening. Inde- 
pendently of his qualifications in other respects, the teacher's 
success in reaching every individual in this large group stamp 
him as exceptional 

Qn another occasion a teacher of a group of about the sa 
size was found to be quite unable to reach beyond the middl 
of the room. Students on the back seats and on the wings of 
the class were passing notes to each other, studying the assig 
ment for another hour, and otherwise following their own d 
vices. It is submitted that whatever personal assets this teac! 
may have possessed—whatever of scholarship, method, or 
sonality—he was not a successful teacher of a large group 

Probably the second teacher was not as good a teacher as t 
first in any respect; but curiously enough, it was of the “absurd 
size of the class that he complained. On the other hand, 
first teacher preferred a large class and declared that he c 
get little inspiration out of a small class. The only objectior 
had to a large class was the clerical work involved—the taku 
of attendance, the writing of scholarship reports, and the rating 
of papers. It would have paid the institution to hire that v 
done for him and to give him the large classes which he 
capable of teaching and which he really enjoyed. 

\t the risk of digressing we wish to remark that we 
never fully understood the attitude of educational administrat 
in insisting that the teacher do all the clerical duties conn¢ 
with his instructional work. There seems to be a feeling 
one cannot teach well unless one pores over test papers. 5 


attention to them is necessary, but much reliance can be pl 


on the proper reports made by readers of these papers. | 
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siness executive fail accurately to administer his affairs 


he does not read all his letters, handle all his orders, or 


se 
every inventory and payroll? He finds he can attend to 
nd larger enterprises by relegating these activities to 
who are paid to handle them and to keep him informed 


rem. So perhaps the teacher could handle larger and 
fairs—larger classes for one thing—if his energies were 
for the real job of teaching. 
at present teachers are neither trained, selected, not 
vith reference to their ability to teach many rather than 
ipils 
he normal school they are taught in the theory courses 
ll classes are to be desired at all events and at all haz 
n their practice teaching they are given small groups of 
frequently from ten to fifteen—and their efforts ar¢ 
to small-class situations 
the selection of teachers we doubt whether superin 
re really considering the ability of candidates to handk 


sses. Yet each superintendent has but a limited amount 


ney which he may spend for teachers’ salaries. If he can 


teachers who can handle large classes, he can either pay 


alaries or have some money left for other things. In all 


rience, however, with the methods of superintendents 11 
teachers we do not re call an instance where a candi- 
> asked the size of the class he could teach or liked to 


Nor do the blanks which are used in connection with 
ents and on which information regarding the expert 


teachers is recorded contain a single item designed to 


ut the success of the candidate in handling large groups 
a 





en 
as we have already indicated, the same neglect of 
- obvious matter is evident in the schemes for rating 
We lately obtained information from a large number 
ntendents as to their plans for appraising the work of 
In no single instance did they estimate the teacher's 


he school svstem on the basis of his success with 
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The fact is that the educational world has been assum 
that good teaching cannot be done in large classes. Superir 
tendents of school systems, presidents of colleges and univer 
sities, and in fact, educators in general have employed much 
their time in bemoaning the size of the classes under their juris 
diction. Two remedies are possible, and only one of them ha 
been tried. The first is to reduce the size of classes. This | 
been everywhere attempted. The other is to secure large-cl 
teachers. This has not been tried, and it should be. T! 
assumption seems to have been made not merely that large cl 
are an evil, but that small classes—no matter how small- 

a blessing to be sought at the sacrifice of almost anything el 

Seldom does the administrator have the unqualified choi 
between the large class and the small class. No factor ent 
so decisively into the cost of education as class size. Accord 
ingly, the administrator must choose one or the other of tl 
following situations: first, the presence of a large number 
teachers each receiving a small salary and teaching a small cl 
or second, a smaller number of teachers receiving larger salaries 
and teaching larger classes. In other words, the cost ele 
has been left pretty largely out of account, while the theoreti 
aspects of class size have held the center of attention. 

If superintendents and other administrators would det 
teachers who could reach the individual student and secure 
intellectual participation despite the fact that he is a membe: 

a large class, and if they would make it known that larg: 
teachers would be paid generously, we believe that some fin 
difficulties would be diminished without necessary detriment 
the quality of the instruction. At any rate, we feel sur 


Ti 


there are small-class teachers and large-class teachers, a1 


the value of the latter has been too little regarded. 
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ry. S. L. anp L. C. Introduction to the use of standard tests. New 
York: The World Book Company, 1922. 263 pp. 

In many instances books dealing with standard measurements present th« 

subject in such technical fashion that the beginner is likely to become hope 

bewildered. The recent book, Introduction to the Use of Standard Tests, 
Sidney L. and Luella C. Pressey, has gone to the other extreme. 

attempting to realize their purpose of presenting a simple manual for 

sts and showing their practical use, the authors have omitted or made only 

f reference to topics which seem essential to workers in this field. The 


er is given the impression that the intelligence quotient of any child is the 





ning factor in his grading. Action based upon this assumption would 
principal or superintendent into serious error. It is the educational 
rather than the mental age which shows the grade to which the child be 
The achievement quotient indicates the excellence of previous work, 
j ' the intelligence quotient shows capacity for future progress. 

McCall says: ‘‘ Educational age is superior to mental age for this pur 
classification) because it and it alone reveals directly what pupils are 
il status educationally. Mental age measures educational status only in 
’? The same point is made very emphatic by Burton in ‘‘ Supervision 

Improvement of Teaching.’’ 
One of the stated purposes of the book is to assist teachers, untrained in 


f tests, to handle test results. How this can be done without cor 


of mode and the normal curve of distribution is difficult to unde 


st Both of these topics are omitted. Correlation is treated in a most in 


te fashion. To say that ‘‘a coefficient of + 1 shows perfect relation 
and omit all reference to its derivation only confuses the beginner for 
help the book it written. 


se who undertake a testing program for the first time rarely concern 
es with the principles of test construction. They want to know how 
ate and interpret test results. The authors devote Chapter XIII, six 
iges, to the topic ‘‘How Tests are Made,’’ and make no reference to 
ial element of variability, save for a brief discussion of ‘‘ scattering’ 
n is by no means common, and is only a step in explaining mode and 
They fail to carry it far enough. Determination of the median 
give a complete picture of class conditions. Two classes might show 
ul central tendencies with the scores of one class ranging from second 


eighth-grade standards, while the second class may have practically no 
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variation from the median. Quartile deviation would seem almost essenti: 
an understanding of the situation. 

Any superintendent about to inaugurate a testing program will find C| 
ter XIV most suggestive. The authors have indicated the successive steps \ 
such detail that failure would seem impossible. Equally valuable is the ce! 
ter dealing with the method of making testing programs worth while. In 

dgment of the writer this would be much more beneficial had some co: 
eration been given to the question of graphical representation. Results s! 
in this way are sufficiently impressive to justify thorough discussion. 

Very wisely, space is economized by omitting all description of tests. R 
resentative tests in each subject are named, leaving the reader to ascert 


cle t 


ails by a study of the tests themselves. 

The Pressey tests have proved so useful that users of these tests wer: 
sibly led to expect more of the book than was reasonable. The treatment 
the subject is too inadequate and superficial to serve as a complete ma 
for the practical school man. Its chief value will be found in its use 


supplement to other and more comprehensive discussions. 


Supert te dent of Schools, Montclair, N. d. 


Counts, GEORGE SyLvestTer. The selective character of American se 
education, (Supplementary Educational Monographs, No. 19.). Cl 


University of Chicago Press, 1922. 162 pp. 


In this book Doctor Counts has made a highly valuable addition 
knowledge that we have from the fermer studies by Vandenburg, H 
Thorndike, Proctor, Book, Burdge, and others concerning pupils in ou 
schools. For 17,992 puipls in the high schools of Bridgeport, Mt. \ 
St. Louis, and Seattle, and also for 514 children of high-school age at v 
Seattle, he reports the parental occupation and its relation to enrollment, 
ress through school, the curriculum elected, and declared expectations 

g graduation. In separate chapters he gives additional information 
public high school and the cultural level, family influences, the immigrant 
negro, and psychological data, with similar facts for two private seco! 
nstitutions, the University of Chicago High School, and Phillips Exeter A 
emy. All these chapters are summarized and then followed by a cautious 
on the high school and democracy. 

Undoubtedly the tremendous growth during the past generation 
school enrollment has increased the heterogeneity of the pupil populati 
probably has also lowered the average of intellectual ability. But Counts s! 
that, at least in the schools studied, the children of families of superior 
and social position enter high school in larger proportion and remain long 


than do their less fortunate fellows. This is of course to be expected s 
as curricula and courses of study are more suited to their capacities, apt 
and probable future needs, although this is far from explaining all of 1 


crease in persistence from the grammar grades. Apparently the ideal f 


presented by the Commission on the Reorganization of Secondary Ed 
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high school is for all children from twelve to eighteen years of age 
more fully adopted by the pupils than by the receiving schools. 

table on page 33 is perhaps the best single summary of the mono- 
It shows the number of children in the high schools of four cities from 


uurteen occupational groups for every 1000 males over 45 years of age 


in that occupation in these cities. For 1000 parents in managerial 
e number of pupils is 400; for those in professional service, 360. 
ther end, for 1000 parents in personal service the number of pupils 
for those in common labor, 17. The peree nt of childret trom 
yr social and professional classes increases sharply from the fresh 
senior year, while that for children of parents in the trades, trans 
public and personal service, and in common labor declines. For 
pupils in the freshman year whose parents are in professional ser 


ain four vears later; for every 1000 freshmen whose fathers are 





rers, 124 remain. The special study of 739 children in the sixth 


Mt. Vernon shows that the selective action begins even before the 

be said that in a general way every observant secondary-school 
knew of this selective process. But it is a valuable service that 
its has rendered in presenting exact facts which must be more o1 
for high schools the country over. Like Burdge’s ‘‘ Our Boys,’’ this 


Doctor Counts is so filled with fundamental data basic t 


e new programs of secondary education that it is difficult to ove 


s importance. It should receive close study and profound refle 


all who are concerned with promoting a sound adaptation of high 
he increasingly heterogeneous body of pupils seeking higher educa 


unless the principles of democracy are denied, its facts must lead 


of curricula, courses of study, methods of teaching, and social 


} 


study is planned with great care, and its conclusions are drawn w 


alification. The only sections that may fairly be impeached uu 
ters are those on first- and last-born children, on negro pupils, and 
groups. On the first topic Counts realizes at least a part of his dif 


the second he is more generous in his interpretation than the 


ther studies would seem to warrant, and in the third he presents 
t a proper consideration of modifying factors Commendati 
made of the unusually clear and helpful graphs supporting the text 


THOMAS H. Brice 


College, Columbia University 


IAM Scort, and others. Remedial cases in reading: their diag 


atment, (Supplementary Educational Monographs, No. 22 CI 
University of Chicago Press, 1922. 208 pp. 

me when investigations in reading run over-much to a mere st 
atment, this intensive study of individual children is parti 
ned. Many of those who have been interested in resear« nh ret 
S} 1d somewhat of squeezing much more juice out of the 
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tion of the results of tests and experiments administered rather crudely t 
masses Of children. Under the influence of the praiseworthy desire to get 
adequate sampling of cases, there has been a tendency to forget that larg 


, ’ 


umbers of cases are significant only when the data for each and every 
have been selected in such a fashion as to give a record of all the importa 
relevant facts. This monograph is also valuable in turning the attentior 
teachers to the need of adapting instruction to the individual. In the enthus 
asm for some of the improved methods of teaching silent reading there is 
tendency to use these methods in a wholesale fashion without sufficient adapta 
ion to the individual child. The data in this monograph are of special sig 
nificance in pointing out the critical nature of the difficulties of exceeding); 
poor re aders. At the same time, the remarkable results obtained by De: 
Gray and his associates are a real inspiration to teachers to work harder 
more intelligently with such children. 


The monograph reports the detailed diagnosis and remedial treatment 


each of 27 pupils at or near Chicago. It also reports a summary of 
edial work done by Dean Gray with the cooperation of Miss Wils 
assistant superintendent of schools at Toledo, Ohio. For each of 27 | 
ere is reported: 1) a general description of the case; (2) a prelin 
iagnosis consisting of an intelligence test and a battery of reading tests 
i detailed diagnosis including a vocabulary test and a detailed ar 


/f various types of oral and reading difficulties; (4) a study of eye 
ments; >) a description of the remedial imstruction; (6) results of 


remedial instruction, reported in tabular form, and an interpretation of 
j results. 

The pupils are deseribed in certain groups under the following lh 

1) pupils who have made little or no progress in learning to read; (2) | 

» encountered serious difficulties in interpretation; (3) pupils wl 

countered difficulties primarily in the mechanics of reading; (4) pupils 

ed difficulties in the rate of silent reading; (5) pupils who 

weak in practically all phases of silent reading. 


The remedial work used by Dean Gray is skillfully organized; and 


harmony with the results of modern experiments and the best classroom 


tice His constant emphasis upon attention to the thought and to inter] 
tion is of especial significance. It is the foundation of his attack in th 


of these deficient pupils, as it should be in the attack of those who are t 
ng ordinary class work in reading. The comprehensiveness of his re 
rk ean be illustrated by quoting his conclusions concerning remedial inst 
yupils who encounter serious difficulties in interpretation: 

An analysis of the reports of individual cases in this chapter s 
clearly that there are certain suggestions which may be followed to advar 
in organizing remedial instruction for any pupil who encounters diff 
in interpretation 1) The interest of the pupil must be aroused and 
peration secured 2) Selections must be used which are directly relat 


the interests of the pupil. (3) A factual background must be devel 


ler to secure accurate interpretations. (4) Specific problems must | 


signed during the early part of the training period in order to direct th 
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significant points. (5) The problems which are assigned at first 
itively simple and should increase in diftic ilty as rapidly as tl 
r of interpretation develops 6) Different types of problems ; 
sned from time to time in order t insure growth in all important 
terpretation. (7) Responsibility for independent interpretations ; 
be imposed on the child. This means that he must re-read 
ssages several times, if necessary, in order to secure ad yuate it | 
S The cooperation of the teachers of content subjects must be 
ler to insure the establishment of good habits of interpretatior 
g activities.’’ 
f these remedial measures is valuable for the tea ng of rea 
ry normal classes. In fact, the summary of causes of failure for 
es of poor readers and the summary of remedial measures cot 
ent outline of a sound course of study in reading 
graph is a valuable addition to the I fessional lib: 


neerned with the problem of teaching reading It maintains 


indards of various Supplementary Educational Monographs w! 
s a result of the research on reading at t I sitv of ( 
tion to being a valuable scientifi tribution, the s pathet 
I WOTE d ne hy lk I Gray 1? ly ny T oS ‘ ~ 

e model for emulation by tl supervis ! ss t 
e a great thing for educat PCOT t S 
whing should be based, as is this ! t | ex ment 
essor who advocates ther 
ERNI | 
ty of Iowa 
| Ar ‘ De y 4 ; ede } if t} , j 


sc pupus were sometimes pi s ‘ eS Ke] S 
meti s onl continued j their first readers The re ‘ ‘ 
a \ Ss ssful eountr mer nt received the et j 

I I successive vears e wore « t f r first rea re! 
erred to above ire comy I t ( lavs of t ! Ss l 
N nger need slow readers ¢ ile ry] ’ ‘ eT 
£ fon 4} intelligent diagnosis , eading , 
on of suitable remedies. 
t I take such diagnosis of ents, the te er must 
wit] proper instruments It py that such instruments ve 
e or less uncritically by some of us in ou diagnosti k It 
necessary that we understand the instruments which we re t 
sis. To this end, Doctor Gray has provided for us an at vsis of 
s and of reading itself from the stand int of these tests The n 
ses of reading from the standpoints of visual perception, the motor 
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processes of reading, and certain higher mental activities which accompany 


reading. These analyses enable the author to set up the only sound basis f 
directing or supervising the study of any school subject, i.e., a knowk 
of processes involved in the pursuit of the subject. 

The second division of the book contains a compilation of tests and met 
ods of observation for diagnostic purposes. Here is found a group of sta 
| oral and silent reading tests with suggestions for their use. The valu 
this portion of the book lies chiefly in the fact that it provides an array 


instruments of diagnosis, together with a discussion of special values of « 


, 
test when used for purposes of diagnosis. One may prefer other tests t 
those here included; but until wider use is made of diagnostic methods, this 
section deserves careful attention. Still finer instruments of diagnosis ar: 
scribed under ‘‘ perception tests’’ and ‘‘tests for motor processes.’’ Most 
the test material in these sections can be used without special apparatus. 
tests here given include tests for the rate of vocalization, for interpretat 
for extraneous movements, breathing during oral reading, eye-movements, 

The last division of the book consists of a critical account of the rem 
work which has been carried on by various teachers and investigators. 
cause of its summarization of the leading monographs and magazine art 
on reading, this section will be valued by many busy persons who have b 
exasperated in their attempts to hold in mind the main currents of the 1 
movements in reading. 

By presenting, first, an analysis of reading; second, an array of di: 
tie instruments; and third, a large number of tested plans, Doctor Gray 
provided a scientific book of the first order. The book should find a pl: 
the activities of all practitioners in reading. It would have great val 
sed as a basis for discussion in a series of teachers’ meetings. 


Wiis L. I 


University of Wisconsin 


Brooks, Sa ‘ 


MUEI SS. Improving schools b y standardized tests. Bx S 





Houghton Mifflin Company, 1922. 278 pp. 

This book is an interesting and detailed story of how Superinte 

ks, a district superintendent of schools in New Hampshire, utilized st 

yl mental and educational tests in the supervision of twenty-six 
ungraded schools. The book begins with a brief description of the cond 
existing within these schools when he became district superintendent. It 
a vivid picture of the inexperienced and untrained teachers, the poor s 

) of grading, the scantiness and poor selection of materials of instructio1 
the decrepit conditions of the buildings. It then tells in detail 
Superintendent Brooks interested the teachers in the giving of standar 
tests, how he trained them for administering the tests, and what use they 

results. It shows how the results were used for classifying the 

for nosing the weaknesses in the instruction of individual childr 

ng instruction, and for measuring the progress of pupils, the effi 


of teachers, and the efficiency of special teaching methods. One chapter 


scribes the application of intelligence tests to individual pupils, and a1 
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r gives the reaction of pupils and teachers to the use of the tests. The 


ve chapters of the book constitute a description of the attempt of the 


ndent and teachers to overcome the poo! reading condition revealed 
testing. These chapters are rich in detail and set forth in clear man 


nstructive program for the teaching of silent reading. 


\s pointed out by Superintendent Brooks in the preface: ‘‘The book is 


in at least two respects: (1) it is a narration of an actual experiences 


in a theory, and (2) it describes in detail how a comprehensive, period 


g program was planned and carried out, how the interested coopera 


e teachers was secured, and how the results of the tests were used 


ve the schools.’’ It is a book on the successful administration and 


m of tests. At the same time it is an excellent treatise on the methods 
reading. To the mind of the reviewer it represents an attempt 
easurements and method. As Buckingham so well savs, the book 

s a ‘‘testing program carried to its logical conclusion.’’ While the 
loes not approve of placing so much dependence upon the single ap 


of a standard test as Superintendent Brooks apparently did, h 


ess ul hesitatingly recommends this book to superint ients, | 
teachers 
CLIFFORD Woop 
of Michigan 
A. Practtce €TerTcwes tn supervised t ly and assi ilati 


Falls, Iowa, Iowa State Teachers College: J. A. Wiley, 1922 


led something ds edl worth 


fessor Wiley, in this little book, has a 
limited literature on Supervised Study and Teaching Children How 

Its contents are unique, concise, and practicable. It will prov 
to teachers who have awakened to the fact that in order to study 
lren must be taught how to study and who feel the need of a 
lirecting the formation of efficient study habits.’ 
s preface the author says in part, ‘‘This book is constructed on the 
at skillful study involves the use of a great variety of specific study 
of which must be built up in conformity with the laws of hal 


We do not acquire a habit by being told about the procedures in 


I 
but rather bv practicing those procedures over and over until they 
fected and reduced to the habit level. Likewise, in learning to study, 
ist first be shown how to use each of the better spec ifie study pr 


id then they must be directed through sufficient practice exercises to 
these study procedures.’’ 

significant that the author recognizes that efficient study (from books 
} 


ny ‘specific study habits’’ each of which must 
f the pupil is to become an all around good student. 


k consists for the most part of directions to the teacher for co 


a58 exercises designed to develop thes¢ specific s udv habits. It - 


thy 


ee parts. Part I deals with the ‘‘General Problem of Rapid 


from the printed page, Part II with ‘‘Spe 
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in Comprehension’’ in silent reading, and Part III with ‘‘ Organizing and | 
pressing Thought.’’ Each part contains several chapters. Each chapter 
with some particular phase of good study ability, and contains definite 


tions Tor conducti several types of class drill de signed to habituate the st 





procedure with which the chapter deals. In addition, the book contains 
tions for checking up progress in the formation of efficient study habits 
means of standardized tests. There is also an introductory chapter whi 
the book for use as a text for a correspondence course in supervised stud) 
On the whole, the book is one of the best aids we know to the s 
of the difficult problem or teaching children how to study. 
S. 8. B 


District Superintendent Winchester, New Hampshire 


MEYER, Max F., A brief manual of psychology demonstrations. Col 

Mo.: Missouri Book Company, 1922. 108 pp. 

This book is designed to furnish illustrative materials for ‘‘The Ps 
chology of the Other One.’’ It ‘‘will help that student who uses the aut 
introductory text, to apply his own hands to the demonstration of certai 
quite ordinary experiences with other people (not with his consciousnes 

The exercises include many of the typical and usual experiments 
psychological laboratory—exercises in reaction-time, estimation of weig 
space-perception, etc. However, the treatment of results and the expla 
material are not at all conventional and undoubtedly justify the author’ 
tention that ‘‘these demonstrations illustrate and thereby further clari 

theories of which the text is composed.’’ 
| E. H. Cameron 
University of Illinois 


MEYER, MAX i The psychology of the other one. Columbia, Mo.: 
Missouri Book Company, 1921. 439 pp. 
In ‘*The Psychology of the Other One’’ we are introduced to the s 
in a highly dramatic way. Robinson Crusoe has just discovered Frida) 
concerned with the problem of how to use him. The Devil appears 


ruise of a missionary and tries to persuade Crusoe to begin his stud 


+ let 


the assumption that Friday has a soul. Crusoe, being thoroughly up-t 





. ’ 
I I 


ogy, has no difficulty in refuting the evil one ev 


iatters of psy ho 
he changes his appearance to that of a philosopher. He is firm in his 
tion to restrict his interest in Friday to what his own sense organs, 0! 


of others, will reveal; for only in this way can he measure Friday, 





there can be no science without measuring. 

As one reads the succeeding chapters, one can scarcely avoid tl 
elusion that the Devil has lived up to his reputation. He has got Cr 
excited about denying the value of the soul that he passes by s 
obvious and important aspects of Friday *s nature Furthermore, he } {) 


. i 


at once to forget his formula of dependence upon sense organs 


observations. 
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Chapter II introduces us to the study of an imaginary lump of living 
tissue something like a snail. It is called a snail for convenience but is much 
simpler than a real snail. This imaginary animal’s activities are explained by 


nery nervous system so simple that its functions can easily be described 





terms of physico-chemical changes. In this way we learn of reflex action. 
In Chapter III we are introduced to the conception of ‘‘ concerted action’’ 
he study of the behavior of a real jelly-fish with a real nervous system. 

t to understand the ‘‘concerted action’’ of the jelly-fish it is necessary first 

to ‘‘imagine the analogous case of eight leaky places on a water pipe. Sup 
se the frequency of the dropping at each place to be about the same, say, 
ne drop a second. gut even then we could not expect all the eight drops 
' | simultaneously; as we say in physics, we could not expect that there 
phase difference among the eight drops. The eight drops would prob 
fall from the eight leaks in a quite irregular succession.’’ Apply this 
to the nervous system of the jelly-fish and you have an explanation of 


neerted action.’’ Friday, too, exemplifies concerted action. For exam- 
an insect lights on Friday’s nose this is what happens: first, he 
} 


es fis nose; 


; second, if the insect has a good hold on his nose he shakes 
ad; third, if this does not remove the insect, he brushes it off with his 
Leaky water pipes explain Friday’s behavior in this instance just as 

lo the concerted action of the jelly-fish. 
After such an introduction it becomes possible for the student to imagine 
t he has ‘‘received from the Creator an appointment of serving as his 
sistant, to have received the task of constructing for the benefit of a given 
al a nervous system which will fulfill its needs.’’ The remainder of the 
is largely devoted to this task of architectural design for a nervous 
vstem which will explain Friday’s behavior. The task is performed in a 
y elaborate and ingenious fashion. The Other-one’s attention, space 
erception, talking and writing, walking in his sleep, ete., are all described 
«plained by this method. The book ends with one last shot at the Devil, 
joes not, however, appear this time in visible form. ‘‘Our interest in 
human beings as souls positively is highly dangerous for human society. 
The most cruel acts of man against man are those committed in 
name of man’s mysterious soul. . . . A rational, a humane treat- 
nt of its individual members is to be expected much more by a society 
h regards itself as a group of organisms than by one which regards itself 
mysterious collective soul.’’ 


E. H. CAMERON 


ersity of Illinois 


EY, CHARLES ELMER. The teacher’s technique. New York: The Century 





Company, 1922. 378 pp. 

cording to its author, this book has been prepared ‘‘for the large 
f teachers who are compelled to attack the teaching problen s of the 
ar grades and high school with very little training to help them.’’ 


, 


regoing probably constitutes the reason for the wide range of topics 


in the book and also for the familiar, descriptive style employed. 
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Technique is not defined, but it is used to mean knowing how and wh 
perform all the duties of a teacher. The author’s intention is that pe 
with little training for teaching will read, and possibly study, the var 
chapters of the book in connection with their work in teaching, To 

such students, the author has provided summaries and exercises for 

chapter and also a detailed outline of the whole book. These devices 

the author’s positions clear and exact—so clear and so exact that, were it 
for the author’s clearly expressed purpose, he might be charged with | 
dogmatic. 

Just how a lone untrained teacher would get on with the book is 
certain. It is, however, certain that a group of teachers in a study cent 
under the direction of a superintendent or extension teacher, would fi 
book profitable. Such group discussions, if current teaching problems 
made prominent, would yield understanding, appreciative insight, an 
creased skill. 

The wide range of topics and the limitations of the size of the bo 
presumably responsible for such startling statements as these: 

‘*The page assignment is the ideal one toward which a teacher s! 
strive.’’ (p. 76) 

‘*The recitation is intended primarily to serve as a means of ascerta 
whether the pupils have performed the tasks set for them in the : 
ment.’’ (p. 78) 

‘*The task of imparting information is the most important one that 
fronts the teacher.’’ (p. 112 


‘*The real psy« iological basis of emotional teaching (?) is the ra 


of feeling attitudes from teacher to pupils.’’ (p. 163) 

‘This radiation of emotional attitudes is the keynote of the 
needed for imparting moral standards.’’ p. 220 

‘The term, review, means in reality a new view.’’ p. 182) 


The book has merit. In a sense, it is a pioneer in the field of what 
stitues teaching technique. To have this field tentatively defined is a 
service to the teaching profession. Then, too, to present within a chapt 
essential things that have been written in several volumes on such sul 
teaching children to study, developing individuality, outcomes of t 
is a distinct service to all of us, including the beginners without p 
tion. The book is an attempt to state the whole round of the t 
work today in much the same way that Page’s ‘‘ Theory and Practice of T: 
ing’’ stated it more than a half century ago. 

Joun A. H. K 


Ntate Normal School, Indiana, Pe nnsylvania 


Burpee, Howarp G. Our boys. A study of the 24501 sixteen-, sé 
and eighteen-year-cld employed boys of the State of New York. A 
J. B. Lyon Company, 1921. 345 pp. 
There have been many statistical studies in the educational field 


the last few years, not a few of which have proved invaluable in h 


establish more scientific methods of administration. But if we limit co1 
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specific type of statistical studies represented by this publication 
y the study entitled ‘‘Our Boys’ 


stands out supreme. 


s claim to superiority is based upon three things: 


] usually large number of records obtained. The investigation 
» with no fewer than 245,000 sixteen-, seventeen-, and eighteen-vear-old 
1 boys in New York state.) 


breadth of the survey. (Forty-two distinct answers of sig 


~ 


nificanes 
kers and students of economy as well as educational administra 


ned from each boy. ) 








highly reliable nature of the figures compiled. This relial 
ssible by the Governor’s edict which required that all information 
publie school teachers in public school buildings | 
[he reviewer cannot refrain from expressing the hope that the same or 
good machinery might be frequently employed in connection with 
s having to do with social and economic welfare. 
the author of ‘‘Our Boys’’ has been satisfied with collec in 
this vast body of information, leaving the interpretation of 
gely to others, and since so many important facts are revealed | 
| 


re ains mie relv to point out such of the sé as pron se TO have 


: i 
ance for readers of this magazine. i 
' 
Six-sevenths of all sixteen-, seventeen-, and eighteen-year-old bovs 
state are out of school. 
Only four boys out of five claim the father as guardiar 
as many fathers as mothers were reported dead. 
i nereent of the boys have neither father nor mother as cuardiar | 


Over 65 percent of these boys remained in school one or more years 
compulsory age limit. 
6. Twenty-five percent left school as soon as legal requirements were met. 
“he oldest boys in families make more rapid progress in school thar 
brothers 
‘. In Greater New York the proportion of boys who complete the 
e is approximately 50 percent greater than that of boys e1 
ast majority of these boys left school because they ‘‘ want 


and not beeause they were obliged t 


ematics is the best liked study. 

English is the least liked study. 

al 10 percent of the boys attend ni 
} 


state that thev do not wish to attend such schools. 


2 


Less than 2 percent of the boys are assisted by schools, churs 


necies in getting employment 
‘ r 40 percent spent less than four and one-half months on their 
here is a distinct, though not marked, correlation between fat 
upations. 
is a high correlation between grades completed and occupation 


l wed. Those who leave school on or be fore completion of the 
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eighth grade enter, for the most part, the industrial trades and oecup: g 
Those who complete one or more years of hi h school work enter the « 
and retail business occupations to a greater degree than the members « 
other g i} 

17. There is but slight correlation between present and desired o: 

s and best and least liked studies. 

By no means the least valuable part of this publication is the ta 

terial from which the numerous correlations were derived. Of part 


» the ‘*doubtiz Thomas’’ type o iperintendent is the cor 


vindication herein published of the random sampling method of interpreting 
data. It seems that a group of skeptics in Buffalo somewhat clandest 
tested the validity of this method by laboriously checking every singk 

of information regarding the 6,468 local boys and comparing the results 
tained with those obtained by means of the random sampling method 
published comparisons provide strong and unequivocal support for th 


method. 





While it would be unsafe for any local administrator to seek to apy 
in full the above conclusions to the solution of his problems, it is safe t 
that many of these conclusions doubtless have almost universal appli 
The chief value of the study, however, uutside of the direct contril 
cited) rests in the advertisement of the fact that we e in our publi S 
syste the machinery for carrying on investigations of real significance 
society and that suc! nvestigations car be n anaged more effectively thr 
this medium than tl! ch any other medium heretofors sed 

D. J. MacbDe 

Ohio State University 
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| News Ftems and Communications 


This department will contain news items regarding research 
workers and their activities. It will also serve as a clearing house 
for more formal communications on similar topics, preferably of not 
more than five hundred words. These communications will be printed 
er the signatures of the authors. Address all correspondence con- 
rning this department to Doctor E. J. Ashbaugh, Ohio State Uni 


versity, Columbus, Ohio. 

















lL) i H ( ie y tes, formerly a me! her of t} Stanford I 

Staff f the sti of gifted chi en, now teaches psychol 

S reachers College, San Jose, California. She is also assistant 

E. Babb Company. B - . tha R , Io <s 
tes that it has been used for 1 re than a vear wit lls 
iversity School of Edueatior e instrument is apy 

. | It is made of ] wood in a form convenient ! 

; e number of 1.Q.’s to figure will find this a labor-sav 

ently received a prognostic test of stenographic ability 


Doctor Elmer R. Hoke of Lebanon Valley College, Annville, Pe 


] ] 


M HT } hs | 1 1 f I or the knowl« t 


Mr. Hoke is also devised a measuring scale 
1 on the general plan of Ayres or Ashbaugh spelling s 
s published by the Gregg Publishing Company. 
children of America saved more than $5,775,000 in the 
oe aceordin 


an Bankers’ Association. The result of their thrift is an i 


ent over the preceding year, and 100 percent more than the t 
1919-20 
Louisville, Kentucky, reports that 98 pereent of its 27,717 
gs accounts. Wilkes Barre, Pennsylvania, claims first 
s of individual deposits averaging $7.54. 


id to note that the Board of Education of Los Angeles is 
[Il of its High School Research Bulletin in printed form. 


st year were outstanding in character. Number 1 of Volume 


se that this year’s ismes will be equ: 


to figures compiled by the Savings Bank Division 


port of Doctor Bobbitt’s work on the curriculum in Los Angeles last 


issued in Number 20 of the Supplementary Educational Mono 
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graphs published by the University of Chicago. Doctor Bobbitt will sper : 
January, February, and March, 1923, in Los Angeles continuing the curricuh j 
study. 

The Board of Education of Pittsburg has issued in its Bulletin Number ¢ 
of the Department of Research and Measurement a course of study in geog 
phy The work was done by a committee under the direction of Mr. Guy, 
rector of the Bureau. Type studies and extensive references are given for t! 
work in grades 11 to vill, inelusive. The bulletin also contains a parallel 
based upon the textbook for grades Iv-A to VI-A, inclusive. Individual schools 


are left free to choose between the two courses. The bulletin is a verita 


mine of valuable suggestions for teachers of geography. 

Persons interested in part-time education should secure monograph 
ber 2 of the 1921 series, published by The Vocational Education Asso: 
of the Middle West. Orders should be addressed to L. W. Whalstrom 


Estes Ave., Chicago. This pamphlet contains an article on each of t 


ving topies: legal standards, standard methods of securing suitable su 


matter, and problems in continuation schools for girls. 

The University of Kansas Bulletin, Volume XXIII, Number 1, cont: 
survey of the schools of Lawrence, Kansas. It was made in the 
year of 1920-21 under the direction of Mr. F. P. O’Brien, director 
Bureau of School Service. The printing of the bulletin was delayed in 


that at least one of the results of the survey eould be reported, i. e@., the 


cessful campaigning for the issuance of bonds for a new building up t 

full legal limit of the city’s capacity. The report is in three sections: 

curriculum needs for secondary education, (2) the school-building ne¢ 
financing the school-building program. 

The school and the chureh in Dublin (Ohio) have joined forces in thi 
lication of a monthly journal for ‘‘the promotion of the religious, mors 
social welfare in community life.’’ The journal contains a large amo 
information about the schools which is in this way brought into the hon 


the people of that little community. 


On November 9 and 10, 1922, Kansas University held a conference o1 
cational Measurements. The University hopes to make this conferet 


annual affair The principal speaker was Doctor B. R. Buckingham 


dressed the conference on the evening of November 9 on ‘‘The Abilit 


Pupils to Solve Verbal Problems in Arithmetic.’’ He also addressed tl 


ference on November 10 on ‘‘A Common-Sense Testing Program,’’ a! 
‘Follow-up Work with Special Reference to Reading.’’ We hope that 
Kent and his colleagues will find enthusiastic support among the sch 


» of Kansas for this University conference. 


At Youngstown, Ohio, an experimental attack upon the problem 


proving the ability of children in arithmetic has been inaugurated. 





N 








etta V. Race, director of research for the board of education, reports 
approach to the problem is being made through a consideration of 
ychology of arithmetic. Considerable work of this sort has been done 
as is attested by the numerous reports now coming from the prir 
As a practical school man remarked a few weeks ago, ‘‘We need the 

in arithmetic.’’ Perhaps Youngstown will supply the ne« 


Assistant Superintendent Albert 8. Cook of Maryland has just issued a 


! letin on silent reading. He takes the position that testing should 
t hing—the same position which is being taken with reference to 
s 1 subjects, notably with reference to spelling. The bulletin gives 


tion as to the choice of reading tests, and takes up the method of train 

e improvement of both speed and comprehension. Norms for silent 

as they have been developed in typical Maryland counties are printed 

se of the bulletin. If this pamphlet is widely circulated in Mar 
scarcely fail to be helpful to teachers of reading. 

Superintendent M. G. Clark of Sioux City, Iowa, has issued an interestir 

let on ‘‘Making High School a Sueccess.’’ It embodies ‘‘a discussi 


sphere, the out-of-school environment, and the attitude of mind 


st be maintained to guarantee to a pupil a measurable degree of 
ublie high-school work.’’ In answer to the question, ‘‘ Does edu 
?’’ the bulletin offers the emphatic answer, ‘‘It does.’’ It discusses 


entals of high-school success and compares the advantages and dis 


s of publie and private high schools. Much of the pamphlet is a 


the parents of publie school pupils. 


irther reference to the advantages of high-school training the 
| Supply Company prints a pamphlet in which every school official 
( nterested. Its appeal is directed to parents and to actual or pr 
school pupils. It presents in a forcible and readable way thi 
1 financial opportunities which secondary education confers. Not tl 
esting feature of the bulletin is the set of cartoons which are int 
with brief statistical statements and editorial comment 


r Luella C. Press y contributes the following story, illustrative of the 
st schools fail to adjust materials and methods to the needs a1 
pupils: Tom brought home a bad report card; whereupon, Tom’s 


t ‘‘up in the air.’’ ‘*Why,’’ inquired the disgusted parent, ‘‘ wl 


, 


u at the top of the class?’ Tom fumbled around in his mental 
tre—which, after all, didn’t appear to be meager—and finally 
*‘*What’s the use, father 


h the same things at both ends. 


of me being at the top instead of at the 


hs) 


“hey teac 
Bureau of School Service and Research of the University of Kansas 
ng a state cooperative study of high-school instruction Tw 


les in that State signified their readiness to participate in the 
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‘‘The Use of 
s written by Doctor Virgil E. Dicksor 
Guidance. The monograph contains a detailed 
in the Berkeley schools with rep 
their use in prognosis. 
sions are worth passing alor 


vanizations 


wraph Number 


itled 


4 issued by 


nt 


a, 1S 


e basis of follow-up f 


a 


enty-five percent of the kindergarten children with an 1.Q 


ce normal progress, and 
[.Q. of 110 or above 


iY 


the 


Mental 


orts 


that 


abe 


Board of 


ieate 3 


director of the 


School Adminis 
Bureau of R 
port of the mental! 


concernil 


The following excerpts from the sur 
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stud rl Burea ndertaken to score and tabulate results f 
el s whi inabl to participate otherwise The of t 
to dat s the Terman Group Test, Thorndike-McCall Reading, B: 
English Form, and Hotz Algebra. It is intended that this study will p: 
a continuous program of testing to extend over perhaps a two-year 
ma f the high-school subjects have bee included and sor 
repeated 
F. P. O’Brie the director of the Research Bureau of the Univ 
Kansas, has recently completed a survey of instruction work in the j 
senior high schools of Lawrence, Kansas. The survey employed ed 
1 mental tests for judging the results of instruction. Nine of th 
| two of the latter were empl yved in both the junior and senior hig! 
! ther items treated in the survey were courses of study, super 
s ction, teaching staff, and costs of instruction. The report will b 
tribution later. 
The Lawrence School Survey has just appeared in the fort 
age printed bulletin of the Kansas University Extension Division. It 
ith the curriculum needs of the high school, a 30-year school-buildi 
nd the financing of such a program. The survey was conducted by t ] 
f School Service and Research, under the « of F. P. O’Brik 
t s already constructed a modern senior high-s | build 
ste é ving out the building program reco led in 1 
port. s&s veral other cities in the state have since authorized similar 
the same bureau 
A study recently completed as a master’s thesis at the Univ 
sas vs that for four high schools in Kansas City, Mo., the stu 
if s uctive participants in the organized activities of thes 
s rank above the non-participants both in school work and 
Alpha test scores. Eligibility regulations, so far as any exist 
é stricted a negligible percent of the non-participants from ben 
+ } 


. = 
the reliahbi 


own that 


le rapid progress ; 


ird 


made 


rapid 
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than ten percent made slow progress. The figures for the first grade 
phatically justify the conclusion that mental tests in the kindergarten 
efinite prognostic value. 

A study of the school records for four and a half years of a group of 
who were given intelligence tests in the first grade showed that the 


n as to school progress—rapid, normal, or slow—has proved true in 


ght pereent of the cases. In ¢ ighteen percent of the cases the failure 
liction was explained on the basis of absences, illness or enviro1 
of the relation of some physical defects to achiever t} 

school by Doetor J. N. Mallory has been issued by the George Pea- 
for Teachers as Contributions to Education, Number 9. The stud 

physicel examinations in charge of a registered nurse, and the 

the following tests: Cleveland Survey Arithmetic, Buckingham 

if the Avres Spelling, Hahn-Lackey Geography, Freeman Writ 

Silent Reading, the Nassau County Supplement to the Hillegas 
the Illinois General Intelligence, and Holl y Picture Completion 
lusions are in part as follows: physical defects are directly as 

achievement scores: phvsi al defects constitute one cause 

and retardation constitutes one cause of backwardness in 

t nsequently, physical defects act both direetly and indirectly 

ness in achievement All defeets do not constitute har li ips 

a8 the same degree. In this respect they should be properly ranked 
ler: nasal obstruc ms and mouth breathing, defective 


resulting maladies, defective hearing, defective tonsils, and defective 


s defective vision as well. The last named, however, seems 


slightly associated with low scores and in some cases the associa 


Survey Bulletin of the schools of Bueyrus Ohio) for November, 1922, 


the use of achievement and intelligence examinations in that school 
Superintendent Paterson makes three surveys of his schools eacl 

pts to obtain something really significant from each survey Data 
reted, conelusions extracted, and remedial efforts gotten under wa 





etin presents a large amount of data on the various tests given to all 


. 
the schools, and the final summaries of achievement are shown in 


to rank in brightness or the sizes of scores on the intelligence exami 
Superintendent Paterson evidently attempts to impress his teachers 
fact that, in general, achievement ranking should be identical with 
ss ranking and that any departure there from is indicative of the 


| 
weakness in the teaching situation. 


’ 


following data from Assistant Superintendent Joseph A. Baer o 


4 
I 


1 County (Ohio) may be of interest to those who are making su 


easurements with intelligence tests: 
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SU 
COMPARISON OI 1.9.’S ON SUCCESSIVE TESTS ILLINOIS EXAMINATION 
—s Number of First Test Second Test 
cases Dec., 1921 Oct., 1922 
itl 16 100.9 104.3 
IV 12 104.8 105.3 
V ll 112.2 
Vi 14 ) 118.4 
Vil 10 116.9 120.0 
Total 63 
Average 112.7 113.3 
Of « rse, these data are not sufficient to be conclusive but there is a 
tly high correlation (r 0.86 based on individual scores) to suggest 
such measure t is likelv to be a rather stable indication of the situat 
y measuremé Superintendent Baer says: ‘‘It would seem that the | 
nois Test measures some quality which is relatively constant with respé 
u I have mn eard anyone assuming that this quality is the whole of 
elusive something called general intelligence. The test does measure wi 
f t goes, and it goes far enough to predict pretty definitely the 
‘ put il doing regular school work. After all, that is the important 
s tion just now.’’ 
¢ aders may remember the first report of the Committ 
Rese h of the Upper Peninsula Educational Association (Michigar 
) she in 1913 \ new report by the same committee has recently come 
' the ess The prese nt re port covers the situation in the Upper Penins 
the llowing points: rural school conditions, cardinal principles of se 
ed tion nd the financial status of city-school systems. The report o1 
conditions shows that 80.5 percent of the teachers are graduates 
r high-school courses. Only 0.02 percent of the teachers are wit! 
ssional training; although 52 percent have had but six weeks whic! 
m amount required by law. Sixteen percent have had mor 
f professional training. In the spring of 26.4 percent 
teachers were completing their first year; 15.8, their second year 
19.8, their third year. The median teaching experience of rural tea 
approximately two and one half years, and the median age is twent 
? teacher has, on the average, six grades with a median of twent 
classes dail though some reported as high as forty-seven. 
Sixteer f twenty-six high schools require physical training 
fori f medical inspection; and only one has a dental clini 
Superintendent William L. Ettinger in a recent address delivers 
t ssociate and district superintendents, examiners, directors, and ins} 
New York City schools showed that on the average each one t 


ho had er 


rad 


ua 


tered school in that city eight years before were dis 


SS; vii-B, 185; vir-a, 8j 


tes, 139; vir-B, 260; vinl-a, 2 
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4, 9; V-B, 2. The percent of promotions was distributed promiscuously 
hout the grades and seemed quite independent of chronological age. Fo. 
e, among 47,000 pupils in the low-first grade the ages ranged from less 
5 to 18. and of the 29,000 pupils in VIII-B the ages ranged from 10 to 18. 
ier hand, the distribution of twelve-year-old children was found to be 


ile 


rst to high-eighth. Forty-three percent of the pupils were found 


+} 


w-tl 
normal age; 26 percent, under age; and 31 percent, over age. These 


re on the basis of a span of a year and a half for each grade. Exam 


the situation from another angle, it was found that among the 30,000 
in the high-eighth grade (admission to which normally assumes 15 
k) three had been in school but 6 terms; six, 7 terms; eight, 
le, at the other extreme, four had been in school 24 terms: twer 
terms; fifty-two, 22 terms. Among the 18,000 who were in their six 
term in school, it was found that one was in high-second grade, two in 


third, eleven in the high-third, and so on until twelve were 
w-tenth, and five in the high tenth 

bility in achievement was found to have a similarly wit 
mple, in spelling, among high-eighth-grade pupils, 
low-eighth-grade average, 13 percent below the high-seventh aver 


} 


lown to 4 percent who were below the low-fiftl 


M A. O. Heck, director of the Bureau of Research at Akron (O has 


1 the following activities of his Bureau for the years 1920-22 


r ir 1920-21 
[. Educational Tests. A survey was made of the entire system it 
es IV-B to VII-A, inclusive, in both October and May in re ‘ ng 
etic, and in October in Sp ling and writing. , 
Il. Practice Tests in Arithmetic. The Courtis Standard Practice 
ts were used in three schools, and the Studebaker Practice Exé 
s s. The results were checked against two control schools. 
II] Mer tal Group Tests. The National Inte lligr nee Tests were Ise 
ghout three schools from Iv-B to vii-A, inclusive, and the Press 
Seale in the same number of schools in lower grades 
L\ eachers and principals were trained in the use of tests This 
-— , 


s accomplished through meetings held with the Director, and the 
were given courses in ‘‘ Measurements.’’ 
V. Age-Grade study. 


For the year 1921-22. 





[. Edueational Tests. A survey ide of the entire svstem ji 
I s to VIII-A, inelusive, with Courtis Superviso Tests in Ar 
September, January, February, and May. An ex} ment wi: 


ed nin reading for the purpose of improving both rate al ] comp! 


S101 Experimental groups were taught by teachers who took a cours 
asurements in which reading was emphasized, and the method of 
ng set up. Control groups were taught by teachers of the same 
ing who were judged by their principals to be of nearly the sam 
tv as those teaching the ex pt rimental gr up. Progress was heck 


use of the Burgess Reading Scale 

Il. Practice Tests in Arithmetic. Courtis Practice Tests were use 
schools and Studebaker, in three. 

[It. Mental Group Tests. One school sectioned its pupils in eacl 


side from I-B to VIII-A, inclusive, on the basis of mental-test results. Two 























! 
; 
: 


schools were tested at the end of the year and sectioned for the following 
year. All pupils in the eighth grade were tested each semester so 
reports of tests were available to the high-school principals. 


time to time, and through classes in extension courses in educational tests 


and measurements. 
V. Age-Grade study. 


The above outline of work of the 


Bureau 
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at 


The purpos 
was to secure data which would possibly enable teachers more wisely 
guide the pupils entering high school in their choice of studies. 

IV. Teachers and principals were trained through meetings held f: 


at Akron is given for the | 


fit of those who may not be acquainted with the lines of activity engage 


by such Bureaus in city school systems. 


The work at Akron 


is not as 


tensive as in some places, but the report of it is decidedly impressive. 


A Note on Arithmetic 


We all agree with the wisdom of Thorndike’s insistence on drill upor 


t 


specific connections which are weak in contrast to indiscriminate practic l 


actual classroom teaching or supervision it is often baffling to determine 


connections are weak. The following is an example of determining the 


connections. 


Consider the following four examples all done incorrectly by members 


a fifth-grade class in the University Elementary School, Iowa City, Lowa 


a 
68798 68798 
TO856 79856 
68597 68597 
217241 197251 


The correct answers are: 


217251 217251 


c d 
65164 64356 
51948 78493 
19485 $6532 
136587 189371 
136597 189381 


It is obvious that these children form the right connections betwee 


numbers themselves, i.e., they know that 7 
21, ete., (from units column, example @). 


Three times they failed to carry Onee they failed to carry 2 but 


16 13, that unseen 134+ se 


Every mistake is one of carrying 


earry 1. In 16 chances to carry, they did so correctly 12 times, once the « 


ing was wrong, 3 times they forgot. 


= 


is where special drill is needed. 


ndue amount of time for a classroom teacher to spot the place for d 


pecially since directed drill saves everyone’s time in the end. 


Uniwersity of Iowa 


The ‘‘earrying’’ habit is weak and t 


Testing Program for Schools of Michigan 


Sixty-seven school systems in various sections of Michigan united 


This analysis took just three minutes, 1 


ly 


B. Kn 


the second week of October in a cooperative testing program, directed 


Bureau of Educational Reference and Research of the University of Mic! 


The extent of the program is clearly shown by the following tables. 


at 
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TABLE I. NUMBER OF TESTS USED IN TESTING PROGRAM 








t Tests Number 
: Elementary Grades: 
Monroe Silent Reading Tests, Form 1................. . 51,000 
Courtis Supervisory Tests in Arithmetic, Forms 3-4...... 72,000 
Woody McCall Mixed Fundamentals, Form 1...........: 30,000 
Spelling Test for all grades, prepared by the Bureau 
based upon the Ayres-Buckingham Spelling Seale. 
High-school English (A study of the improvement resulting 
m the first year of instruction in high-school English 
F Van Wagenen Reading Scale in English Literature, 
NE AS irs rata a a ae tere nein mike we a ial kat eo rte evecare Rw eka 6,500 
Kirby Grammar Scale, Form 1..............0.6: ee 
Briges Bae Peres Test, AMORs osc icsicvcscevescwees 7,500 
High-school Latin—(An evaluation of the special phases of 
teaching Latin in cooperation with the American Classica] 
Li ague ): 
Carr’s English Vocabulary Test, Form A........... ce 4500 
Uhlman-Kirby Latin Comprehension Test, Form 1........ 1,600 
Godsey’s Latin Diagnostic Composition Test, Form 1.... 1,600 
rABLE Il. SCHOOL SYSTEMS PARTICIPATING IN PROGRAM 
Parts! } | Parts! Parts! 
1,2, 3 || Kast Lansing 5 3 || Manistee 1.2 
1,2, 3 || Farmington 1,2, 3 || Marine City 2 
y l Ferndale l, Marysville cz 23 
l Flint 4 2, 3 || Mich. State Nor- 
rbor 1,2, 3 || Fenton. 12oé mal = 3 
ul 1, 2, 3 || Goodrich 1,2, 3 || Midland 1,3 
\ 1,2, 3 Grand Rapids l Morley 1,3 
g 1,2 Grayling 1,2, 3 || Mt. Clemens ee 
. e Cree l Greenville 1,2, 3 || Mt. Pleasant ee 
it 1,2, 3 || Gwinn 1,2, 3 || New Troy 1,2 
10n l || Harbor Beach 1,2, 3 || Otsego FS 
Springs.| 1, Hastings... 1,2, 3 || Paw Paw 3 
g ls 1, 2,3 || Highland Park 1,2, 3 || Pontiac 1.2.3 
ngham 1,2, 3 || Holley 1,2 Port Hope 2 
City 1,2, 3 || Hopkins. 1,2, 3 || Saginaw, W 1 
I l Howell l Sault Ste. Marie) 1,2, 3 
( 1, 2, 3 || Hudson 1,2, 3 || Stanton Ss 
( City 1 Ionia. . l Tawas City l 
vater 1, 2, 3 || Ironwood 1,2, 3 || Vicksburg 1,2,3 
Wagiar l Iron River 1,2, 3 || Wyandotte Ls 3% 
lurand 3 Jonesville 1,2, 3 || Yale = 
I 1, 2,3 || Kalamazoo 1,2, 3 || Ypsilanti i. 
Lakeview. 1 Zeeland 1.2.3 
imerals 1, 2, 3, after the names, represent the parts of the program—ek 
English, and Latin, respectively, in which the schools participated 
\ A ling to the provisions of the program each school system will for- 
ts tabulated results to the Bureau where general summaries will be econ 


1 and published in its regular bulletin. 
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Some Fallacies in Testing Intelligence Tests 

In the March, 1922 issue of this Journal, Henmon and Streitz presented 
an article entitled ‘‘A Comparative Study of Four Group Scales for the Pri 
mary Grades.’’ These scales are: Pressey Primer, Haggerty Delta 1, Dear 
born Series 1, and Myers Mental Measure. The authors compared and 
appraised these four tests chiefly on the basis of four criteria. Assuming for 
argument that these are valid criteria, we shall examine the procedure and the 
explicit and implicit inferences by these authors. 

Correlation with teachers’ estimates.—‘‘ Aside from the Pressey test in th 
second grade of school A, and the Myers test in the first grade of school B, 
the correlations are high and do not differ greatly,’’ they say. But they 
do not say how many children were in the first- and second-grade classes tested 
in each school, and there were only 50 children altogether in the first-grade 
group and in the second-grade group, respectively. In spite of this fact t! 
authors draw rather definite conclusions, which must suggest to the averag 
reader of their study that these data are representative of all children. Of 
course probable errors are given, but a probable error can have little significar 
unless there is a guarantee that the cases were a wholly random selection. It 
were almost impossible to pick out two entire school classes of a given grade 
anywhere that would be representative, say, of 10,000 children randoml) 
selected from children of that grade. If these authors had picked out four 
other classes, who knows but that the relative correlations for the four tests 
would have been entirely different. 

We do not know whether any of the children tested were of foreign pai 
entage or not, but since none scored very low on the Haggerty test w! 
presupposes familiarity with some school symbols, one may infer that all of 
these children were fairly familiar with English. But in the average Ame 
class of school children, especially of the first and second grade, ther 
children who can scarcely understand or speak English. Among such child 
these four tests would give, according to this criterion as well as by 
other three criteria, very different ranking of the tests, perhaps, from t! 
found by Henmon and Streitz. 

Discriminative capacity.—‘ ‘Other things being equal, that test is 1 
useful which segregates most clearly and unambiguously different age or gra 
groups,’’ they say; and then, ignoring the age factor, they study overlappi 
purely on grade basis. How does the reader know whether or not there a! 
more over-aged children in the second grade than in the first, that the larg 
overlapping by the Myers and Pressey tests is not what the probable age dis 
crepancy would warrant? Granting no age discrepancy, and that for ages 
these tests ranked for overlapping as they do for grades, even then by w! 
authority of fact do Henmon and Streitz say that the less overlapping 
better. How do we know whether the overlapping of actual intelligence 
correctly measured, would not even be greater than that found for the Myers 


Mental Measure, the test which showed for them the greatest overlapping 
may be that a six-year-old child does not differ in native capacity from th 
seven-year-old child nearly so much as any verbal test has suggested. 


M ayue 











Hn aie 


Jan., 1923 NEWS ITEMS AND COMMUNICATIONS 85 


the apparent difference has been due, in a large measure, to what was indicated 
y those elements in intelligence tests (including the Stanford-Binet) which 
irre most affected by school experience. 

On page 193 the authors proceed to compare medians and the differences 
etween the medians of the first and second grades for each test. But this 
procedure is wholly unsound since, in the first place, the ranges of the four 
scales and the successive units of measure on each scale are not at all com- 
mensurable. Worse still, the Haggerty, Dearborn, and Pressey tests are de- 
signed for the first three grades only, whereas the Myers Mental Measure 
is designed for all ages and school grades. Because of its wide range of 
application the Myers test could not be expected to show so great difference 
between the medians of successive grades as would those tests designed for 
very limited range of ages and grades. Assuming, then, for argument that 
the Myers Mental Measure is least discriminating between the first two grades, 
of the four tests compared, it should still be noted that the authors start their 
thesis on this subject with: ‘‘Other things being equal.’’ The impression 
left is that other things are equal. If they wished to leave a correct impression, 
me might question why they did not point out this unique feature of the 
Myers Mental Measure which, because of its universal range of application, 
admits of the study of overlapping not only of the first two or three grades 
but of these three grades with higher grades. The break of the Dearborn, 
Pressey, and Haggerty tests at the end of the third grade forbids one’s finding 
by them the overlapping of the third and fourth grades, of the first and fourth 
les, of the second and fourth, of the third and fifth, and so on. 
Character of the distribution curve-—Can any one of scientific habits 
nsider seriously the relative distributions of these four tests by 50 cases? 
\ssuming again for argument that the number of cases was large enough for 
consideration, even then the conclusions arrived at by the authors are not borne 


5 & 


out by the curves and tables upon which these conclusions are based. In 
spite of the facts to the contrary, the authors says (p. 194): ‘‘but an in 
pection of Figures 1 to 4 and Table I show fairly close conformity to the 
normal curve except in the case of the Myers test.’’ Just why ‘‘except’’? 
Let the reader paste a screen over the labels of these graphs and present 
them to any group of students familiar with the ‘‘normal curve’’; or let 
m present a copy of a ‘‘normal curve’’ to a group of intelligent laymen 
1 ask them which pair of graphs conform most closely to this model, and 
will find the Myers Mental Measure ranking more often first than last. 


\ rently the authors made up their verdict by a kind of visual average of 
two graphs in each instance. Since they made no attempt to compare 
stribution curves for each grade why did they not assist in this visual 


raging by merging the two graphs into one, that is, by merging first- an 
grade graphs for each test? If the reader will take the trouble to do 
he will find that the Myers Mental Measure looks about the best instead 
{ the worst. If then, he will turn to ‘‘ Measuring Minds’’ by the writer and 


Mrs. Myers, pages 17-21, he will find for over 5,000 cases, approximately 


rmal distributions for every age and school grade, including college students. 
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Adminstration and scoring.—Although the authors have failed on t 
counts to give conclusive proof of the relative validity of the four tests, t 
assume that the Myers Mental Measure was knocked out in the third round 
for they wholly ignore it in the fourth. At this point the average reader 
their article must have assumed that the Myers test deserves no longer 
considered by him as a possibility for use. 

Henmon and Streitz seem to evaluate this last point on general impress 
for they write: ‘‘ According to the examiner’s reports, the Pressey test 
high in these respects since it can be given in twenty-five minutes and s 
in three minutes. The Haggerty test also ranks high as it can be 
thirty minutes and seored in five minutes. But they seem disturbed ov 
longer time required for the Dearborn test and think it ‘‘ fatiguing an 
boresome to many of the children.’’ However, they do not tell us th 
or time in which these four tests were given; neither do they suggest rm 
weights of the four criteria set up by them. If the umpires had wis! 
extend to the Myers Mental Measure the sportsman’s consideration, 
might have noted that this test can be given in less than half an ho 
scored in about two minutes; and that it can be used as a continu 
on an entire school population. 

The shortcomings of the study of Henmon and Streitz are all th 
serious because they implicitly suggest at the outset that they are going 
furnish a rather conclusive guide for the selection of intelligence tests 
the first two grades, for they say: ‘‘ Departments of education and psy: 
are importuned for advice and counsel as to the validity, reliability, ar 
tive merits of such scales as are in the market.’’ The undiscriminati: 
certainly can have come to no other conclusion than that these authors 


furnished such ‘‘advice and counsel.’’ 
GARRY CLEVELAND My 


Cleveland School of Education 
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: ON THE RELATION BETWEEN SPEED AND ACCURACY OR QUALITY OF WORK 
Frank N. Freeman, University of Chicago 

Che problem of relationship between speed and quality is one on which 

re has been a rather wide divergence of opinion, and on which the evi 
has not been particularly conelusive. Perhaps it is safe to say that the 

of opinion now is that there is positive correlation between speed and 

ty of work. 

' \ rather well-known investigation on this point was that made on the 
ct of reading in the Cleveland Survey. By means of the ninefold 

y ping it was made clear that there was some correlation between rate of 
g and comprehension. The correlation, however, was not high. Some 

rs ago a graduate student in the Department of Education, University of 

igo, gave the Burt Reasoning Tests to a group of high-school students 

time allowance was sufficient to allow all of the students to finish, and 

I time taken by each student was recorded. The correlation between the 
which in this case was independent of the rapidity of the work, and 
: the speed of the performance was calculated and was found to be zero. This 


d to indicate that for some types of performance at least, there is little 
relation between speed and quality of work. 
In an effort to get additional information upon this problem a study was 
of the relation between speed and score in two standardized tests on a 
s in mental tests during the summer quarter of 1922. There were 114 
nts, largely graduate students, from whom complete records were obtained. 
Ss was given two tests upon the content of the course. One of these 
iltiple-answer test, and the other a completion test. The rank order 
speed of performance in tests was determined by kee ping a recor 
in which the papers were turned in. The first question to be asked 
ther the order of completion is any indication of characteristic rate o 
f the individuals. In order to determine this, the correlation between 
ler of finishing in the two tests was determined and found to b 
05. This indicates a fair degree of reliability of this measure. The 


ty of the tests themselves is indicated roughly by the correlation 


y 


the two tests which was 0.55 + .047. Since the content of the two 


is in part different this indicates again a fair degree of reliability. 


tion between speed and quality of performance was measured by 
g the correlation between the score in each test and the order of finis 
lhese two correlations were respectively . 13 = .07, 12+ .07. The 
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similarity of the results in the two tests is striking. It appears rather « 
therefore, that so far as this situation is concerned, the speed of pert 
and the quality of performance are not related, 

it is interesting to speculate on the possible factors which affect s; 
and quality of work and the relation between them. What the bea 
these factors is we cannot say with any assurance, Future investigati 
isolate them and indicate their relative importance. It is also possil 


still other factors may be discovered. 

In the first place, it is possible that high degree of ability may op 
to render high quality of performance possible and also to affect fay 
the speed of performance. In so far as this is true there should be a p 
correlation between speed and quality. The most common view has pr 
been that this hypothesis is the correct one. In the second place the a 
of a good method of procedure or training in good method should p1 
both raise the quality of performance and increase its speed. Poor tr: 
or lack of training would operate in the opposite direction. Such a fa 
this would again produce a correlation. 

While these two factors may exist, it is clear that they cannot exist 
in the light of the fact that the correlation is sometimes not present. W 
therefore set up certain other hypotheses. For example, there may be 
difference in the rate of working or in the rate of activity in gener: 
this may be relatively independent of the quality or work of whiecl 
capable. Observation seems to indicate that this is true, at leas 
degree. There are some persons who act slowly, but who seem cay 
performing difficult intellectual feats, and on the other hand there ar 
who are very rapid in their responses, both mental and physical, but 
mental capacities are very limited. Similarly there may be real di 
in the quality of work of which one is capable which are independ 
speed of performance. This is the other side of the same situation 
In addition to these possible fundamental characteristics of inte 


makeup, there may be differences in ways of working which are mort 





accidental. For example, unusual carefulness in mental work may pr 





somewhat higher quality than would otherwise be produced, but may) 

at the expense of speed. On the other hand a person may work reckl 

in this way speed up at the expense of quality Such differences it 
be due not to fundamental differences in the nature, but to diff 


in the type of training or in temporary attitude. 


The relation between speed and accuracy may further be affect 
lifficulty of the test itself. It is conceivable at least that a test wit! 
range of difficulty which is easy enough to permit those of little 
uke a score, but difficult enough to tax the ability of the ablest w 

‘ 


less rrelation between speed and quality ft in a test wh ech is eas 


which the seore was determined 


This hypothesis suggests a beginning point for experimentation 


roblem. If one should take the same roup of individuals and 


relation between speed and quality with a variety of tests, some 


} 
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sy and some difficult, he could determine whether or not this hypothesis 
ground. 
whole problem is one which has more than merely theoretical im 
It is important in the first place for interpretation of the results 
sts. If there is low correlation between speed and quality a speed test 
» injustice to certain types of pupils. If there is high correlation on 
er hand, such a test would at least do much less injustice. In the 
place, if there are marked differences in the type of performance with 
e to speed and quality of different persons this may have an important 
upon the kind of vocation to which various individuals are suited. 
ations may demand rapidity to a much greater extent than others. 
ther hand the quality of performance in some cases may greatly out 
the importance of speed. Further investigation of this problem there 


ses to be not only theoretical, but of practical importance. 


SCHOOL SURVEYS 


Direction of the Department of Measurement and Research 
Unive sity of Neb ska 


; 


Doctor Fordyce has recently sent out circulars which give directions for 


g surveys. The following paragraphs indicate the nature of the work 
s being carried on: 
\ number of superintendents in Nebraska are engaged this year in 
a critical study of their local school system. This study embraces 
riculum; achievements of the pupils; quality of instruction; supervi- 
lassification and progress; social activities; school hygiene; selection, 
and tenure of teachers; judging the conditions of the buildings and 
nts, through the use of standardized score cards; and finally the 
ss administration including records, reports, and expenditures. These 
s are to be put in the form of a detailed report, at the close of the year, 
itted to the Board of Education. Keen interest is manifest this 
he application of the standardized scales for the purpose of guiding 
s and superintendents in determining the ability of the pupil and for 


the course of study and the teaching to his needs.’’ 


ARDIZING TESTS IN FUNDAMENTALS OF ALGEBRA AND GEOMETRY 
W. C. Brenke, Professor of Mathematics 

“or some years past these tests have been prepared by the Department 
thematies of the University of Nebraska and sent out by the Uni- 
Extension Division on the request of high schools. About seventy 
were received from as many different schools, and about one-third 
sent in reports of results which are tabulated below. Unmarked papers 

a number of schools are not included. In most cases the average, 
le, and lowest marks made by the class are given. The same 
} 


imi 


er does not as a rule indicate the same school. This tabulation 


ve to the teachers who gave the test an approximate indication of the 
» performance of their classes: 
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School : 


School 


TABLE I. ALGEBRA 
A ver- Mid- 
age High dle 
83 100 83 

77 100 81 
75 100 87 
75 100 75 
75 91 
75 100 90 

84 73 

67 100 

90 67 

66 L100 83 
66 100 66 
63 92 80 
60 9S 66 

100 65 
100 63 
100 62 

58 SS 57 

58 100 50 
DS 100 56 
50 100 58 

91 39 
TABLE Il. GEOMETRY 
A ver- Mid- 
age High dle 

83 100 67 
78 100 &3 
74 98 75 

100 72 

69 98 71 
68 90 67 
65 90 68 

90 67 

64 84 67 
60 90 60 
60 78 60 
60 R5 55 

100 60 
55 80 67 
55 100 55 
83 67 
51 95 33 
93 18 
50 R4 
R2 18 

40 50 40 

38 63 38 


30 


16 
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